Oct 30 06:53:51.965923 ip-10-0-132-33 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 06:53:51.965937 ip-10-0-132-33 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 06:53:51.965946 ip-10-0-132-33 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 06:53:51.966272 ip-10-0-132-33 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 06:54:02.003824 ip-10-0-132-33 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 06:54:02.003840 ip-10-0-132-33 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b36f699709fe40c89fb48264e970d9e6 --
Oct 30 06:55:54.656109 ip-10-0-132-33 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 06:55:55.080905 ip-10-0-132-33 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 06:55:55.080905 ip-10-0-132-33 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 06:55:55.080905 ip-10-0-132-33 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 06:55:55.080905 ip-10-0-132-33 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 06:55:55.085330 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085252    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.085330 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085329    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.085330 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085333    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085336    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085339    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085342    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085344    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085347    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085350    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085353    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085355    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085358    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085360    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085364    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085367    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085369    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085372    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085375    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085377    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085380    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085383    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085385    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.085420 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085388    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085390    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085393    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085395    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085398    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085401    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085407    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085410    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085412    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085415    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085418    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085421    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085424    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085427    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085430    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085433    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085436    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085438    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085441    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.085912 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085444    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085446    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085448    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085451    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085453    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085456    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085459    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085461    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085464    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085467    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085469    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085472    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085474    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085477    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085479    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085483    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085486    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085489    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085492    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.086361 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085495    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085498    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085500    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085504    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085508    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085511    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085514    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085518    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085521    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085524    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085526    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085529    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085532    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085534    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085537    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085540    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085542    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085545    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085547    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085550    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.086805 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085553    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085558    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085562    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085565    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085568    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085571    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085574    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085577    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085580    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085583    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085586    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085588    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085591    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085594    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085596    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085599    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085602    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085604    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085607    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.087286 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085610    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.087772 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085613    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.087772 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085615    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.087772 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085618    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.087772 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085621    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.087772 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085623    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.087772 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.085626    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.088287 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088274    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.088287 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088286    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088290    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088293    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088296    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088299    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088302    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088306    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088309    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088311    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088314    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088317    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088319    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088322    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088325    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088327    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088330    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088332    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088335    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088337    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088341    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.088340 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088344    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088347    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088349    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088352    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088355    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088357    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088360    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088363    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088365    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088368    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088370    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088373    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088375    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088378    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088382    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088385    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088388    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088391    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088393    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.088824 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088397    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088399    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088402    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088404    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088407    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088409    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088412    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088415    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088417    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088420    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088422    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088425    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088427    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088431    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088433    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088437    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088439    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088442    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088445    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088447    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.089284 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088450    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088452    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088455    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088458    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088460    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088463    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088465    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088468    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088470    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088473    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088475    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088478    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088480    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088483    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088486    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088488    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088491    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088493    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088496    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088499    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088502    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.089757 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088504    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088506    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088509    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088511    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088514    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088516    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088519    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088522    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088525    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088527    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088530    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088533    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088535    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088538    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088540    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088543    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088545    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088548    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088550    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.090275 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088553    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088555    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088558    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088563    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088567    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.088571    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089065    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089071    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089074    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089077    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089080    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089082    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089085    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089088    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089090    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089093    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089096    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089098    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089101    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.090723 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089104    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089107    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089109    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089112    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089115    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089117    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089120    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089123    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089125    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089128    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089130    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089133    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089135    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089138    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089140    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089142    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089145    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089148    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089151    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089154    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.091182 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089157    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089159    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089162    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089167    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089170    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089172    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089175    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089177    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089180    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089183    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089185    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089188    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089190    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089193    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089195    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089198    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089200    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089203    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089206    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.091662 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089208    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089211    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089213    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089216    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089219    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089221    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089224    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089226    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089229    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089232    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089234    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089237    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089239    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089242    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089245    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089247    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089251    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089254    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089256    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089259    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.092254 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089261    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089264    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089267    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089269    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089271    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089274    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089277    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089279    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089282    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089285    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089288    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089291    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089294    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089298    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089301    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089303    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089306    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089309    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089311    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.092729 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089314    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089316    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089321    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089324    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089327    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089329    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089332    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089335    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089337    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089340    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089343    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089346    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089348    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089351    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.089353    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090711    2584 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090721    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090727    2584 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090733    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090737    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090740    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 06:55:55.093218 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090745    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090749    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090752    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090755    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090758    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090762    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090765    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090768    2584 flags.go:64] FLAG: --cgroup-root=""
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090771    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090774    2584 flags.go:64] FLAG: --client-ca-file=""
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090776    2584 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090779    2584 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090785    2584 flags.go:64] FLAG: --cluster-domain=""
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090788    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090791    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090794    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090798    2584 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090802    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090805    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090808    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090812    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090815    2584 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090818    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090821    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 06:55:55.093706 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090825    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090827    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090832    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090835    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090838    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090841    2584 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090844    2584 flags.go:64] FLAG: --enable-server="true"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090846    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090863    2584 flags.go:64] FLAG: --event-burst="100"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090866    2584 flags.go:64] FLAG: --event-qps="50"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090869    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090872    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090875    2584 flags.go:64] FLAG: --eviction-hard=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090879    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090882    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090885    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090888    2584 flags.go:64] FLAG: --eviction-soft=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090891    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090894    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090897    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090900    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090903    2584 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090906    2584 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090909    2584 flags.go:64] FLAG: --feature-gates=""
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090913    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 06:55:55.094301 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090917    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090920    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090924    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090927    2584 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090930    2584 flags.go:64] FLAG: --help="false"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090934    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090937    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090940    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090943    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090946    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090949    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090952    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090955    2584 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090959    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090962    2584 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090965    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090968    2584 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090971    2584 flags.go:64] FLAG: --kube-reserved=""
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090974    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090977    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090980    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090983    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090986    2584 flags.go:64] FLAG: --lock-file=""
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090988    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 06:55:55.094910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090991    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.090994    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091000    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091003    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091008    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091011    2584 flags.go:64] FLAG: --logging-format="text"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091014    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091017    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091020    2584 flags.go:64] FLAG: --manifest-url=""
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091023    2584 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091028    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091031    2584 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091035    2584 flags.go:64] FLAG: --max-pods="110"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091038    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091041    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091044    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091047    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091049    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091053    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091055    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091062    2584 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091065    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091068    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091071    2584 flags.go:64] FLAG: --pod-cidr=""
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091074    2584 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 06:55:55.095474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091077    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091080    2584 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091083    2584 flags.go:64] FLAG: --port="10250"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091086    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091089    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-091f32acca7f7fdfd"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091092    2584 flags.go:64] FLAG: --qos-reserved=""
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091095    2584 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091099    2584 flags.go:64] FLAG: --register-node="true"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091102    2584 flags.go:64] FLAG: --register-with-taints=""
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091106    2584 flags.go:64] FLAG: --registry-burst="10"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091109    2584 flags.go:64] FLAG: --registry-qps="5"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091113    2584 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091115    2584 flags.go:64] FLAG: --reserved-memory=""
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091119    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091122    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091126    2584 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091128    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091131    2584 flags.go:64] FLAG: --runonce="false"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091134    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091137    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091141    2584 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091144    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091147    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091150    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091153    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091157    2584 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 06:55:55.096084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091159    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091162    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091165    2584 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091168    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091171    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091174    2584 flags.go:64] FLAG: --system-cgroups=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091177    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091182    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091186    2584 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091189    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091194    2584 flags.go:64] FLAG: --tls-min-version=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091197    2584 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091200    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091204    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091208    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091211    2584 flags.go:64] FLAG: --v="2"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091215    2584 flags.go:64] FLAG: --version="false"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091220    2584 flags.go:64] FLAG: --vmodule=""
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091224    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091227    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091357    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091360    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091363    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091366    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.096728 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091369    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091372    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091376    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091386    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091389    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091392    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091395    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091398    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091400    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091403    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091405    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091408    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091411    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091413    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091416    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091418    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091421    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091424    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091426    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.097316 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091429    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091432    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091436    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091438    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091441    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091444    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091446    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091449    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091452    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091454    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091457    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091459    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091462    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091464    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091467    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091470    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091472    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091475    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091486    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091490    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.097765 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091493    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091496    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091498    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091501    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091503    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091506    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091509    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091511    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091514    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091516    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091519    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091522    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091524    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091527    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091531    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091535    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091538    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091542    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091545    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091548    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.098261 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091551    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091554    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091557    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091559    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091562    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091564    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091567    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091569    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091572    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091575    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091578    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091581    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091583    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091586    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091589    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091591    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091594    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091596    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091599    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091601    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.098734 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091604    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091607    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091609    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091612    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091614    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091617    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091621    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091623    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091626    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091629    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091631    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091634    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091636    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091639    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091641    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091644    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091646    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091649    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091651    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091654    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.099221 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091656    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091659    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091661    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.091688    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091726    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091731    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091734    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091737    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091742    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091747    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091749    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091752    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091755    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091758    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091761    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.099702 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091764    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091766    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091769    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091771    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091775    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091778    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091780    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091783    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091786    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091789    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091791    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091794    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091797    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091799    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091801    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091804    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091807    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091809    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091812    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.100164 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091814    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091817    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091821    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091823    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091826    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091829    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091832    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091835    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091837    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091840    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091842    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091845    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091847    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091862    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091864    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091867    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091870    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091873    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091876    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091879    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.100622 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091882    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091884    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091887    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091890    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091893    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091896    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091900    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091903    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091906    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091909    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091912    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091914    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091917    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091919    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091922    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091925    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091928    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091931    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091935    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.101095 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091937    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091940    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091942    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091945    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091948    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091951    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091953    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091956    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091959    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091961    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091965    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091968    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091971    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091974    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091977    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091979    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091982    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091984    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091987    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091989    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.101545 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091992    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091996    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.091998    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092001    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092003    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092006    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092009    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092011    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092014    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092016    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092019    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092023    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092026    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092028    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092030    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092033    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.092036    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.099167    2584 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.099181    2584 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 06:55:55.102064 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.099193    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.099198    2584 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099251    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099256    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099259    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099262    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099265    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099267    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099270    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099273    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099276    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099280    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099284    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099288    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099291    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099294    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099297    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099300    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099303    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.102504 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099305    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099308    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099311    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099314    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099317    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099319    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099322    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099325    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099328    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099330    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099333    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099336    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099339    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099342    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099344    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099347    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099350    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099353    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099356    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.102970 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099358    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099361    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099364    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099366    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099369    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099372    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099374    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099377    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099379    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099382    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099384    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099387    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099389    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099392    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099394    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099397    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099399    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099403    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099406    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.103410 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099408    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099411    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099413    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099416    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099418    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099421    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099424    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099427    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099429    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099432    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099434    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099437    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099440    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099442    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099445    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099447    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099450    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099452    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099455    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.103919 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099457    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099460    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099462    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099465    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099467    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099470    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099472    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099475    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099477    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099489    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099492    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099494    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099498    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099500    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099503    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099505    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099508    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099511    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099514    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099516    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.104348 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099519    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099521    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099524    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099527    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099531    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099534    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099537    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099540    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099543    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099545    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099548    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099550    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.099577    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099722    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099728    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.104804 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099731    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099734    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099737    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099740    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099742    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099745    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099747    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099750    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099752    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099755    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099759    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099762    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099765    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099768    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099771    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099774    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099777    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099779    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099782    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.105165 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099785    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099787    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099790    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099792    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099794    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099797    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099800    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099802    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099805    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099808    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099811    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099813    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099816    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099818    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099821    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099823    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099826    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099828    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099830    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099833    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.105643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099835    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099838    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099840    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099843    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099846    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099862    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099866    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099869    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099872    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099875    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099878    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099880    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099883    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099885    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099888    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099890    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099893    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099895    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099898    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099900    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.106972 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099903    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099905    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099908    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099910    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099913    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099915    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099917    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099920    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099922    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099925    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099927    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099930    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099932    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099935    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099937    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099940    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099942    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099945    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099948    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099951    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.107443 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099953    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099956    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099958    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099961    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099963    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099966    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099970    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099973    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099976    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099979    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099982    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099985    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099987    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099990    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099992    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099995    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099997    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.099999    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100002    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.107937 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100004    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100007    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100009    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100012    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100014    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100017    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.100040    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100070    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100076    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100080    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100083    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100086    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100088    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100091    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100094    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100096    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:55:55.108429 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100098    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100101    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100103    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100106    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100108    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100111    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100113    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100116    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100118    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100121    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100123    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100126    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100128    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100131    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100133    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100136    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100138    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100141    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100143    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100146    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:55:55.108813 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100148    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100150    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100153    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100157    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100160    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100163    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100166    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100169    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100172    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100175    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100178    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100180    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100183    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100185    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100188    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100190    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100193    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100196    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100198    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:55:55.109450 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100201    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100203    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100206    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100208    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100211    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100217    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100219    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100222    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100224    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100227    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100229    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100232    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100234    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100237    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100239    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100242    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100244    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100247    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100249    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100252    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:55:55.109968 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100255    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100258    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100261    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100263    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100266    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100268    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100271    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100273    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100276    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100278    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100281    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100283    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100286    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100289    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100291    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100293    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100296    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100300    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100303    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100305    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:55:55.110530 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100308    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100310    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100313    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100315    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100318    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100320    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100322    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100325    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100328    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100330    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100333    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100335    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100339    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100342    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100345    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100348    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100351    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:55.100353    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.100401    2584 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 06:55:55.111105 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.102805    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 06:55:55.111563 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.103885    2584 server.go:1014] "Starting client certificate rotation"
Oct 30 06:55:55.111563 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.103978    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 06:55:55.111563 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.104016    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 06:55:55.111563 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.106274    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 06:55:55.111563 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.111456    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 06:55:55.127057 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.127039    2584 log.go:25] "Validated CRI v1 runtime API"
Oct 30 06:55:55.131016 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.131001    2584 log.go:25] "Validated CRI v1 image API"
Oct 30 06:55:55.131919 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.131896    2584 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 06:55:55.138732 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.138714    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8d1b9418-125d-46cc-8725-2fae71405a51:/dev/nvme0n1p3 a8f84757-d3d2-4182-aab0-b0e9f32f150b:/dev/nvme0n1p4]
Oct 30 06:55:55.138783 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.138733    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 06:55:55.143941 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.143813    2584 manager.go:217] Machine: {Timestamp:2026-10-30 06:55:55.142398725 +0000 UTC m=+0.379068613 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098322 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7e1bc14d444450c1e81fc25095bd SystemUUID:ec2c7e1b-c14d-4444-50c1-e81fc25095bd BootID:b36f6997-09fe-40c8-9fb4-8264e970d9e6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d2:30:65:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d2:30:65:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:f3:35:89:c6:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 06:55:55.144602 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.144592    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 06:55:55.144683 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.144672    2584 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 06:55:55.147375 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.147345    2584 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 06:55:55.147522 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.147377    2584 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 06:55:55.147572 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.147525    2584 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 06:55:55.147572 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.147533    2584 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 06:55:55.147572 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.147570    2584 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 06:55:55.147649 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.147589    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 06:55:55.148920 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.148910    2584 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 06:55:55.155302 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.155289    2584 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 06:55:55.155417 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.155408    2584 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 06:55:55.156262 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.156253    2584 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 06:55:55.156293 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.156267    2584 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 06:55:55.156293 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.156277    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 06:55:55.156293 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.156286    2584 kubelet.go:405] "Adding apiserver pod source"
Oct 30 06:55:55.156375 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.156296    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 06:55:55.156596 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.156575    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 06:55:55.159036 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.159016    2584 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 06:55:55.165919 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.165904    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 06:55:55.166943 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.166931    2584 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 06:55:55.166987 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.166970    2584 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 06:55:55.167153 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.167141    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 06:55:55.167190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.167166    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 06:55:55.167190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.167173    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 06:55:55.167190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.167179    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 06:55:55.167190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.167186    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 06:55:55.167302 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.167195    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 06:55:55.168106 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.168097    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 06:55:55.168145 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.168107    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 06:55:55.168145 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.168114    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 06:55:55.168145 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.168121    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 06:55:55.168145 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.168130    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 06:55:55.168145 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.168139    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 06:55:55.169020 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.169010    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 06:55:55.169020 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.169020    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 06:55:55.173626 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.173611    2584 server.go:1263] "Started kubelet"
Oct 30 06:55:55.173770 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.173709    2584 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 06:55:55.173770 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.173738    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 06:55:55.173877 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.173796    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 06:55:55.174346 ip-10-0-132-33 systemd[1]: Started Kubernetes Kubelet.
Oct 30 06:55:55.175781 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.175765    2584 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 06:55:55.176221 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.176201    2584 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 06:55:55.180959 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.180941    2584 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 06:55:55.182279 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.182256    2584 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 06:55:55.182360 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.182261    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 06:55:55.182630 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.182446    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.183737 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.183036    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 06:55:55.183737 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.183337    2584 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 06:55:55.183737 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.183352    2584 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 06:55:55.183931 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.183784    2584 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 06:55:55.183931 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.183794    2584 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 06:55:55.184030 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184015    2584 factory.go:55] Registering systemd factory
Oct 30 06:55:55.184076 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184035    2584 factory.go:223] Registration of the systemd container factory successfully
Oct 30 06:55:55.184245 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184230    2584 factory.go:153] Registering CRI-O factory
Oct 30 06:55:55.184296 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184246    2584 factory.go:223] Registration of the crio container factory successfully
Oct 30 06:55:55.184296 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184294    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 06:55:55.184375 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184310    2584 factory.go:103] Registering Raw factory
Oct 30 06:55:55.184375 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.184324    2584 manager.go:1199] Started watching for new ooms in manager
Oct 30 06:55:55.185264 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.185251    2584 manager.go:319] Starting recovery of all containers
Oct 30 06:55:55.199768 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.198475    2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 06:55:55.199959 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.199946    2584 manager.go:324] Recovery completed
Oct 30 06:55:55.201453 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.201426    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Oct 30 06:55:55.204352 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.204336    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.205948 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.205931    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.206014 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.205960    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.206014 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.205970    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.206532 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.206519    2584 cpu_manager.go:226] "Starting" policy="none"
Oct 30 06:55:55.206532 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.206531    2584 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 06:55:55.206659 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.206554    2584 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 06:55:55.206659 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.206534    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.207263 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.207248    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.207316 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.207278    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.207316 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.207291    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.208944 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.208808    2584 policy_none.go:50] "Start"
Oct 30 06:55:55.208944 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.208815    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 06:55:55.208944 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.208826    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 06:55:55.208944 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.208822    2584 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 06:55:55.208944 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.208839    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 06:55:55.209923 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.208817    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-33.ec2.internal.18e33c47ad6d702f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-33.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-33.ec2.internal,},FirstTimestamp:2026-10-30 06:55:55.173564463 +0000 UTC m=+0.410234351,LastTimestamp:2026-10-30 06:55:55.173564463 +0000 UTC m=+0.410234351,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-33.ec2.internal,}"
Oct 30 06:55:55.210979 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.210966    2584 policy_none.go:44] "Start"
Oct 30 06:55:55.223966 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.223949    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lsn8v"
Oct 30 06:55:55.225012 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.224985    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 06:55:55.225012 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.224947    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-33.ec2.internal.18e33c47af5b8bdf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-33.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-33.ec2.internal,},FirstTimestamp:2026-10-30 06:55:55.205946335 +0000 UTC m=+0.442616222,LastTimestamp:2026-10-30 06:55:55.205946335 +0000 UTC m=+0.442616222,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-33.ec2.internal,}"
Oct 30 06:55:55.225282 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.225261    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 06:55:55.225442 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.225420    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 06:55:55.239100 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.239084    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lsn8v"
Oct 30 06:55:55.248567 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.248532    2584 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 06:55:55.254055 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254041    2584 manager.go:341] "Starting Device Plugin manager"
Oct 30 06:55:55.254150 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.254065    2584 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 06:55:55.254150 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254074    2584 server.go:87] "Starting device plugin registration server"
Oct 30 06:55:55.254325 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254311    2584 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 06:55:55.254385 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254324    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 06:55:55.254484 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254471    2584 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 06:55:55.254587 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254543    2584 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 06:55:55.254587 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.254553    2584 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 06:55:55.255103 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.255085    2584 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 06:55:55.255175 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.255125    2584 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.262748 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.262673    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-33.ec2.internal.18e33c47af5bd6e7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-33.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-33.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-33.ec2.internal,},FirstTimestamp:2026-10-30 06:55:55.205965543 +0000 UTC m=+0.442635431,LastTimestamp:2026-10-30 06:55:55.205965543 +0000 UTC m=+0.442635431,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-33.ec2.internal,}"
Oct 30 06:55:55.305649 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.305621    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 06:55:55.307683 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.306921    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 06:55:55.307683 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.306943    2584 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 06:55:55.307683 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.306961    2584 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 06:55:55.307683 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.306991    2584 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 06:55:55.323111 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.323094    2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:55:55.355183 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.355018    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.357697 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.357680    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.357776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.357717    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.357776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.357733    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.357776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.357757    2584 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.377254 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.377236    2584 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.377332 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.377256    2584 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-33.ec2.internal\": node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.408653 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.408624    2584 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"]
Oct 30 06:55:55.408736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.408692    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.409393 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.409378    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.409458 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.409406    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.409458 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.409415    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.411655 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.411643    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.411803 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.411787    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.411875 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.411826    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.412324 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.412307    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.412393 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.412338    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.412432 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.412311    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.412432 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.412417    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.412432 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.412428    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.412750 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.412734    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.414848 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.414833    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.414945 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.414867    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:55:55.416357 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.416208    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.416357 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.416255    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:55:55.416357 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.416280    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:55:55.416357 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.416302    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:55:55.447239 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.447222    2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-33.ec2.internal\" not found" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.449712 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.449699    2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-33.ec2.internal\" not found" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.485608 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.485589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.485682 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.485612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.485682 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.485629    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a762c70289af1190dfbc46ead76d62e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"a762c70289af1190dfbc46ead76d62e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.516526 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.516505    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.585882 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.585841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.585882 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.585888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.586027 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.585903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a762c70289af1190dfbc46ead76d62e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"a762c70289af1190dfbc46ead76d62e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.586027 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.585929    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.586027 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.585938    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a762c70289af1190dfbc46ead76d62e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"a762c70289af1190dfbc46ead76d62e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.586027 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.585953    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.616874 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.616811    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.717605 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.717581    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.750248 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.750229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.752358 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:55.752339    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:55.819399 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.819367    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:55.921542 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:55.921483    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:56.024263 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:56.024231    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:56.103621 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.103592    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 06:55:56.104027 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.103735    2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 06:55:56.125512 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:56.125483    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:56.226550 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:56.226481    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:55:56.245437 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.245392    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 06:50:55 +0000 UTC" deadline="2028-06-05 01:15:39.597503458 +0000 UTC"
Oct 30 06:55:56.245437 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.245432    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14010h19m43.352074298s"
Oct 30 06:55:56.267434 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.267414    2584 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:55:56.282689 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.282670    2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:56.310757 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.310735    2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 06:55:56.312221 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.312207    2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:55:56.335398 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.335381    2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 06:55:56.366669 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.366641    2584 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:55:56.454019 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:56.453979    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda762c70289af1190dfbc46ead76d62e3.slice/crio-54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2 WatchSource:0}: Error finding container 54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2: Status 404 returned error can't find the container with id 54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2
Oct 30 06:55:56.462190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.462167    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 06:55:56.466390 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:56.466361    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747e6823a71c3697d810e3c5e2c39baa.slice/crio-c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86 WatchSource:0}: Error finding container c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86: Status 404 returned error can't find the container with id c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86
Oct 30 06:55:56.721880 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:56.721772    2584 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:55:57.158331 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.158257    2584 apiserver.go:52] "Watching apiserver"
Oct 30 06:55:57.184704 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.184675    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 06:55:57.191196 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.191170    2584 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 06:55:57.191475 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.191457    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-fnh8d","openshift-multus/multus-additional-cni-plugins-qn9r5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j","openshift-multus/multus-2snxl","openshift-network-diagnostics/network-check-target-jlk9l","openshift-network-operator/iptables-alerter-p6pb4","openshift-ovn-kubernetes/ovnkube-node-zm7qp","kube-system/global-pull-secret-syncer-mvld4","kube-system/konnectivity-agent-thvhj","openshift-cluster-node-tuning-operator/tuned-hvtgp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal","openshift-multus/network-metrics-daemon-76th7","kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal","openshift-dns/node-resolver-kg9qk"]
Oct 30 06:55:57.194492 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.194463    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.196985 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.196963    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.199150 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.199127    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.201869 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.201843    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.204663 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.204642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.207020 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.206823    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.210541 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.210521    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.212985 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.212967    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 06:55:57.213094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.213049    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8vngf\""
Oct 30 06:55:57.213094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.213069    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 06:55:57.213240 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.213209    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 06:55:57.213303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.213274    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.213356 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.213328    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.213408 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.213383    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.215502 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.215480    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.216599 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.216580    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6h5pm\""
Oct 30 06:55:57.216599 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.216595    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 06:55:57.216766 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.216748    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 06:55:57.217261 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.217239    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.218019 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.217998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.218126 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.218098    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:55:57.218661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.218554    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.218661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.218580    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7szgh\""
Oct 30 06:55:57.218661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.218594    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 06:55:57.218661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.218589    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.218661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.218580    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 06:55:57.218661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.218634    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 06:55:57.219053 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.219036    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.219735 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.219716    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 06:55:57.221433 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.220854    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.221433 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.220912    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:55:57.222876 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.222857    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:55:57.222994 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.222911    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:55:57.226768 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226742    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.226888 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226820    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-s8tns\""
Oct 30 06:55:57.226888 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226842    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q4jsx\""
Oct 30 06:55:57.226888 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226851    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.227063 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226924    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 06:55:57.227063 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226958    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.227063 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.226993    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-th56t\""
Oct 30 06:55:57.227063 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.227017    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.230541 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.230288    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.230541 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.230371    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.230541 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.230467    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2tccl\""
Oct 30 06:55:57.231934 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.231896    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 06:55:57.231934 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.231965    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 06:55:57.231934 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.231984    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-44sjc\""
Oct 30 06:55:57.232211 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.232037    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 06:55:57.243417 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.243395    2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 06:55:57.243620 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.243467    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9llq5"
Oct 30 06:55:57.284264 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.284238    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 06:55:57.295181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295153    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-ovn\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.295303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295187    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.295303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-bin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.295303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295227    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-multus\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.295303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b23a23e6-395f-4501-aab1-be26e3ff2236-agent-certs\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.295303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-socket-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.295303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295301    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-system-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295328    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295356    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9pc\" (UniqueName: \"kubernetes.io/projected/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-kube-api-access-jd9pc\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-systemd-units\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-slash\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295415    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1c149b5-13ba-423f-a970-98da3c328798-ovn-node-metrics-cert\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295462    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-multus-certs\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-tmp\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-dbus\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/580c167c-2e1f-4dbd-86b2-4412e856f1c2-host-slash\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295570    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-cnibin\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.295636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295633    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295659    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-netns\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-kubelet\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-systemd\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-registration-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295726    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-run\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295746    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dae48309-e15e-4919-a6d3-051758b7a23e-serviceca\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295768    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbp6\" (UniqueName: \"kubernetes.io/projected/46375128-278b-46e4-ace2-13374ad65d23-kube-api-access-2kbp6\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-netns\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-bin\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-device-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295936    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47gx5\" (UniqueName: \"kubernetes.io/projected/334689c1-93d2-4b74-8d46-20890f606782-kube-api-access-47gx5\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295962    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysconfig\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.295989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-netd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.296319 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cni-binary-copy\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-conf-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296071    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-conf\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-var-lib-kubelet\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-host\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296142    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-node-log\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-env-overrides\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvfcl\" (UniqueName: \"kubernetes.io/projected/f1c149b5-13ba-423f-a970-98da3c328798-kube-api-access-pvfcl\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae48309-e15e-4919-a6d3-051758b7a23e-host\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296283    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-etc-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-config\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/334689c1-93d2-4b74-8d46-20890f606782-hosts-file\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296414    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-hostroot\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-sys\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296464    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b23a23e6-395f-4501-aab1-be26e3ff2236-konnectivity-ca\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/334689c1-93d2-4b74-8d46-20890f606782-tmp-dir\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.297140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296516    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-system-cni-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cnibin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296565    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-k8s-cni-cncf-io\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-tuned\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296618    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-kubelet\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296647    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296674    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-sys-fs\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-daemon-config\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-modprobe-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296774    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-kubernetes\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgp67\" (UniqueName: \"kubernetes.io/projected/dae48309-e15e-4919-a6d3-051758b7a23e-kube-api-access-tgp67\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296949    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296968    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx76m\" (UniqueName: \"kubernetes.io/projected/497c3d29-4ad7-4314-b73a-8015ea05057f-kube-api-access-mx76m\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.296985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297003    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-socket-dir-parent\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.297776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297067    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6r4j\" (UniqueName: \"kubernetes.io/projected/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kube-api-access-b6r4j\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lml\" (UniqueName: \"kubernetes.io/projected/580c167c-2e1f-4dbd-86b2-4412e856f1c2-kube-api-access-h2lml\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-kubelet-config\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-systemd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-log-socket\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-script-lib\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297170    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/580c167c-2e1f-4dbd-86b2-4412e856f1c2-iptables-alerter-script\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297187    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2pv7\" (UniqueName: \"kubernetes.io/projected/04664ebb-d94a-4bfe-a346-b441a7da0e3f-kube-api-access-n2pv7\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-etc-kubernetes\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-lib-modules\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.298579 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.297255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-var-lib-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.312540 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.312492    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"747e6823a71c3697d810e3c5e2c39baa","Type":"ContainerStarted","Data":"c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86"}
Oct 30 06:55:57.314033 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.313998    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" event={"ID":"a762c70289af1190dfbc46ead76d62e3","Type":"ContainerStarted","Data":"54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2"}
Oct 30 06:55:57.320889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.320747    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 06:55:57.320889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.320855    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 06:55:57.320889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.320851    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-f2h44\""
Oct 30 06:55:57.397649 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-kubelet\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.397825 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.397825 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-sys-fs\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.397825 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397741    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-daemon-config\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.397825 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397771    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-sys-fs\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.397825 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397781    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-kubelet\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.397825 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397788    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-modprobe-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-kubernetes\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397895    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397923    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-modprobe-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp67\" (UniqueName: \"kubernetes.io/projected/dae48309-e15e-4919-a6d3-051758b7a23e-kube-api-access-tgp67\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398010    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx76m\" (UniqueName: \"kubernetes.io/projected/497c3d29-4ad7-4314-b73a-8015ea05057f-kube-api-access-mx76m\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-socket-dir-parent\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.398068    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398091    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.398147    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:55:57.898123358 +0000 UTC m=+3.134793257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:55:57.398177 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6r4j\" (UniqueName: \"kubernetes.io/projected/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kube-api-access-b6r4j\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lml\" (UniqueName: \"kubernetes.io/projected/580c167c-2e1f-4dbd-86b2-4412e856f1c2-kube-api-access-h2lml\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.397976    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-kubernetes\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-kubelet-config\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398265    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-systemd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-log-socket\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-script-lib\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/580c167c-2e1f-4dbd-86b2-4412e856f1c2-iptables-alerter-script\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398342    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-kubelet-config\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398404    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-systemd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398430    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-daemon-config\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398446    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-log-socket\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2pv7\" (UniqueName: \"kubernetes.io/projected/04664ebb-d94a-4bfe-a346-b441a7da0e3f-kube-api-access-n2pv7\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-etc-kubernetes\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398061    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398557    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-lib-modules\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.399050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398613    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-var-lib-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398626    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-etc-kubernetes\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398650    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-ovn\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398668    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-ovn\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398696    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398713    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-var-lib-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-bin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398741    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398609    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-socket-dir-parent\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-multus\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b23a23e6-395f-4501-aab1-be26e3ff2236-agent-certs\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398804    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-lib-modules\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-socket-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398847    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-system-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9pc\" (UniqueName: \"kubernetes.io/projected/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-kube-api-access-jd9pc\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.399889 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398907    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-socket-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.398962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-systemd-units\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-slash\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1c149b5-13ba-423f-a970-98da3c328798-ovn-node-metrics-cert\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399090    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-system-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-multus-certs\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-tmp\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399128    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399149    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-dbus\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399176    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/580c167c-2e1f-4dbd-86b2-4412e856f1c2-host-slash\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399201    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399227    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-cnibin\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399268    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-cnibin\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-netns\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.400736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-kubelet\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399355    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/580c167c-2e1f-4dbd-86b2-4412e856f1c2-iptables-alerter-script\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-systemd\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399415    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-systemd\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-registration-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-run\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399509    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/580c167c-2e1f-4dbd-86b2-4412e856f1c2-host-slash\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399525    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-dbus\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399711    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399721    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-netns\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399752    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399757    2584 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399764    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-multus-certs\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399766    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-kubelet\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399813    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-systemd-units\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.399844    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-multus\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400004    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-bin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400043    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-slash\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.401569 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400073    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-registration-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400095    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dae48309-e15e-4919-a6d3-051758b7a23e-serviceca\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400123    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-run\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbp6\" (UniqueName: \"kubernetes.io/projected/46375128-278b-46e4-ace2-13374ad65d23-kube-api-access-2kbp6\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400234    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-netns\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400266    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-script-lib\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-bin\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-device-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47gx5\" (UniqueName: \"kubernetes.io/projected/334689c1-93d2-4b74-8d46-20890f606782-kube-api-access-47gx5\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysconfig\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-netd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400452    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cni-binary-copy\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-conf-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400507    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-bin\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-conf\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400562    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-conf-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400587    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dae48309-e15e-4919-a6d3-051758b7a23e-serviceca\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-var-lib-kubelet\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-host\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-node-log\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400689    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-env-overrides\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400711    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-conf\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfcl\" (UniqueName: \"kubernetes.io/projected/f1c149b5-13ba-423f-a970-98da3c328798-kube-api-access-pvfcl\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400770    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-node-log\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400774    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysconfig\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400810    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-netns\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400856    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-var-lib-kubelet\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400891    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-netd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.400947    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-device-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.401012    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.401062    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret podName:a45a4f45-8253-4317-82ca-9edf34f33dbd nodeName:}" failed. No retries permitted until 2026-10-30 06:55:57.901045769 +0000 UTC m=+3.137715665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret") pod "global-pull-secret-syncer-mvld4" (UID: "a45a4f45-8253-4317-82ca-9edf34f33dbd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401111    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.402878 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401147    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae48309-e15e-4919-a6d3-051758b7a23e-host\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-etc-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401178    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-env-overrides\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401215    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-config\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401239    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-host\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401283    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401323    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/334689c1-93d2-4b74-8d46-20890f606782-hosts-file\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-hostroot\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-sys\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401380    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cni-binary-copy\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401389    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-etc-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401425    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-sys\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b23a23e6-395f-4501-aab1-be26e3ff2236-konnectivity-ca\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401456    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-hostroot\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401464    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/334689c1-93d2-4b74-8d46-20890f606782-hosts-file\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/334689c1-93d2-4b74-8d46-20890f606782-tmp-dir\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401530    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae48309-e15e-4919-a6d3-051758b7a23e-host\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.403636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-system-cni-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cnibin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-k8s-cni-cncf-io\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-tuned\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401870    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/334689c1-93d2-4b74-8d46-20890f606782-tmp-dir\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401996    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cnibin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.401997    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-config\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.402046    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-k8s-cni-cncf-io\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.402056    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-system-cni-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.402087    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b23a23e6-395f-4501-aab1-be26e3ff2236-konnectivity-ca\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.404652 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.403784    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b23a23e6-395f-4501-aab1-be26e3ff2236-agent-certs\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.405721 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.405620    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-tmp\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.405721 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.405679    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1c149b5-13ba-423f-a970-98da3c328798-ovn-node-metrics-cert\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.406928 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.406904    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-tuned\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.423311 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.423147    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 06:55:57.423311 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.423173    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 06:55:57.423311 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.423186    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ps8pz for pod openshift-network-diagnostics/network-check-target-jlk9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:55:57.423311 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.423251    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz podName:bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b nodeName:}" failed. No retries permitted until 2026-10-30 06:55:57.923230136 +0000 UTC m=+3.159900035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ps8pz" (UniqueName: "kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz") pod "network-check-target-jlk9l" (UID: "bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:55:57.428957 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.428927    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lml\" (UniqueName: \"kubernetes.io/projected/580c167c-2e1f-4dbd-86b2-4412e856f1c2-kube-api-access-h2lml\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.429146 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.429124    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx76m\" (UniqueName: \"kubernetes.io/projected/497c3d29-4ad7-4314-b73a-8015ea05057f-kube-api-access-mx76m\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.430638 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.430531    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbp6\" (UniqueName: \"kubernetes.io/projected/46375128-278b-46e4-ace2-13374ad65d23-kube-api-access-2kbp6\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.430638 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.430562    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfcl\" (UniqueName: \"kubernetes.io/projected/f1c149b5-13ba-423f-a970-98da3c328798-kube-api-access-pvfcl\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.430997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.430975    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47gx5\" (UniqueName: \"kubernetes.io/projected/334689c1-93d2-4b74-8d46-20890f606782-kube-api-access-47gx5\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.431946 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.431450    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9pc\" (UniqueName: \"kubernetes.io/projected/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-kube-api-access-jd9pc\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.431946 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.431565    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6r4j\" (UniqueName: \"kubernetes.io/projected/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kube-api-access-b6r4j\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.433091 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.433057    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2pv7\" (UniqueName: \"kubernetes.io/projected/04664ebb-d94a-4bfe-a346-b441a7da0e3f-kube-api-access-n2pv7\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.433668 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.433626    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgp67\" (UniqueName: \"kubernetes.io/projected/dae48309-e15e-4919-a6d3-051758b7a23e-kube-api-access-tgp67\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.531513 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.531472    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:55:57.542243 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.542214    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2snxl"
Oct 30 06:55:57.544118 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:57.544092    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c149b5_13ba_423f_a970_98da3c328798.slice/crio-3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373 WatchSource:0}: Error finding container 3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373: Status 404 returned error can't find the container with id 3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373
Oct 30 06:55:57.548489 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.548465    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:55:57.550685 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.550237    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:55:57.556191 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.555036    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:55:57.557909 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.557881    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:55:57.560980 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.560929    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:55:57.567519 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:57.567490    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334689c1_93d2_4b74_8d46_20890f606782.slice/crio-10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5 WatchSource:0}: Error finding container 10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5: Status 404 returned error can't find the container with id 10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5
Oct 30 06:55:57.570298 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.570117    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:55:57.572135 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:57.572110    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46375128_278b_46e4_ace2_13374ad65d23.slice/crio-6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5 WatchSource:0}: Error finding container 6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5: Status 404 returned error can't find the container with id 6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5
Oct 30 06:55:57.576092 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.576061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:55:57.578750 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:57.578727    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580c167c_2e1f_4dbd_86b2_4412e856f1c2.slice/crio-b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913 WatchSource:0}: Error finding container b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913: Status 404 returned error can't find the container with id b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913
Oct 30 06:55:57.585297 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:57.585260    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38e4bfa_c76a_459a_b0c2_2f731ca919fc.slice/crio-efbb85253fbfe4db091f845ff110d8fb45415d28c72f3c40fc63727d40596a15 WatchSource:0}: Error finding container efbb85253fbfe4db091f845ff110d8fb45415d28c72f3c40fc63727d40596a15: Status 404 returned error can't find the container with id efbb85253fbfe4db091f845ff110d8fb45415d28c72f3c40fc63727d40596a15
Oct 30 06:55:57.587825 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:55:57.587793    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae48309_e15e_4919_a6d3_051758b7a23e.slice/crio-41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590 WatchSource:0}: Error finding container 41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590: Status 404 returned error can't find the container with id 41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590
Oct 30 06:55:57.649295 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.649268    2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:55:57.906154 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.906120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:57.906348 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:57.906197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:57.906348 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.906266    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:55:57.906348 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.906319    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 06:55:57.906348 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.906348    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:55:58.906324712 +0000 UTC m=+4.142994608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:55:57.906602 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:57.906373    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret podName:a45a4f45-8253-4317-82ca-9edf34f33dbd nodeName:}" failed. No retries permitted until 2026-10-30 06:55:58.906356962 +0000 UTC m=+4.143026860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret") pod "global-pull-secret-syncer-mvld4" (UID: "a45a4f45-8253-4317-82ca-9edf34f33dbd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 06:55:58.008085 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.008051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:55:58.008238 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.008209    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 06:55:58.008238 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.008226    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 06:55:58.008238 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.008236    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ps8pz for pod openshift-network-diagnostics/network-check-target-jlk9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:55:58.008238 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.008281    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz podName:bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b nodeName:}" failed. No retries permitted until 2026-10-30 06:55:59.008268963 +0000 UTC m=+4.244938840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps8pz" (UniqueName: "kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz") pod "network-check-target-jlk9l" (UID: "bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:55:58.247336 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.247221    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 06:50:57 +0000 UTC" deadline="2028-07-01 21:04:09.506399128 +0000 UTC"
Oct 30 06:55:58.247336 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.247289    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14654h8m11.259114204s"
Oct 30 06:55:58.308044 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.307492    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:58.308044 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.307622    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:55:58.320661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.320577    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thvhj" event={"ID":"b23a23e6-395f-4501-aab1-be26e3ff2236","Type":"ContainerStarted","Data":"a890cebd9d21e4b967ab90b3577c7e7c4da438e598e8fc1ce39e1e889255df07"}
Oct 30 06:55:58.328386 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.328287    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvtgp" event={"ID":"f38e4bfa-c76a-459a-b0c2-2f731ca919fc","Type":"ContainerStarted","Data":"efbb85253fbfe4db091f845ff110d8fb45415d28c72f3c40fc63727d40596a15"}
Oct 30 06:55:58.333795 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.333712    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerStarted","Data":"6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5"}
Oct 30 06:55:58.338281 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.338190    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j" event={"ID":"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4","Type":"ContainerStarted","Data":"baaa9ce67de7d65c84bb3cdcb409d613fe548e1cac5ed074133fa41c5a16f91e"}
Oct 30 06:55:58.341703 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.341623    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fnh8d" event={"ID":"dae48309-e15e-4919-a6d3-051758b7a23e","Type":"ContainerStarted","Data":"41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590"}
Oct 30 06:55:58.367536 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.367409    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6pb4" event={"ID":"580c167c-2e1f-4dbd-86b2-4412e856f1c2","Type":"ContainerStarted","Data":"b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913"}
Oct 30 06:55:58.383278 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.383218    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kg9qk" event={"ID":"334689c1-93d2-4b74-8d46-20890f606782","Type":"ContainerStarted","Data":"10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5"}
Oct 30 06:55:58.396233 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.396201    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2snxl" event={"ID":"04664ebb-d94a-4bfe-a346-b441a7da0e3f","Type":"ContainerStarted","Data":"c30516b149097c8d0ef03d7d7af0de911603a8df11dca8a5e113b948741b4689"}
Oct 30 06:55:58.398588 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.398561    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373"}
Oct 30 06:55:58.914641 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.914393    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:55:58.914837 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:58.914688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:58.914983 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.914965    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 06:55:58.915048 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.915037    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret podName:a45a4f45-8253-4317-82ca-9edf34f33dbd nodeName:}" failed. No retries permitted until 2026-10-30 06:56:00.915018296 +0000 UTC m=+6.151688180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret") pod "global-pull-secret-syncer-mvld4" (UID: "a45a4f45-8253-4317-82ca-9edf34f33dbd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 06:55:58.915477 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.915458    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:55:58.915555 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:58.915513    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:56:00.915498331 +0000 UTC m=+6.152168211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:55:59.015500 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.015464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:55:59.016179 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:59.015683    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 06:55:59.016179 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:59.015710    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 06:55:59.016179 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:59.015723    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ps8pz for pod openshift-network-diagnostics/network-check-target-jlk9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:55:59.016179 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:59.015780    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz podName:bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b nodeName:}" failed. No retries permitted until 2026-10-30 06:56:01.015761729 +0000 UTC m=+6.252431622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps8pz" (UniqueName: "kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz") pod "network-check-target-jlk9l" (UID: "bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:55:59.248418 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.248302    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 06:50:57 +0000 UTC" deadline="2028-04-22 23:15:59.464055766 +0000 UTC"
Oct 30 06:55:59.248418 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.248337    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12976h20m0.215723491s"
Oct 30 06:55:59.315133 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.315101    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:55:59.315576 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:59.315319    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:55:59.315992 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.315855    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:55:59.316108 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:55:59.316020    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:55:59.414391 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.413403    2584 generic.go:356] "Generic (PLEG): container finished" podID="747e6823a71c3697d810e3c5e2c39baa" containerID="8d9c7638a6d8da603b00e376817b431116540f87dfc458ae4db52db197673e02" exitCode=0
Oct 30 06:55:59.414391 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.413490    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"747e6823a71c3697d810e3c5e2c39baa","Type":"ContainerDied","Data":"8d9c7638a6d8da603b00e376817b431116540f87dfc458ae4db52db197673e02"}
Oct 30 06:55:59.428162 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.428130    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" event={"ID":"a762c70289af1190dfbc46ead76d62e3","Type":"ContainerStarted","Data":"3fd82a20110c8560213fc414af74caafa1926ddfa7b7e6b2d37c464a684adbbc"}
Oct 30 06:55:59.505733 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:55:59.505626    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" podStartSLOduration=3.505607771 podStartE2EDuration="3.505607771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:55:59.504980785 +0000 UTC m=+4.741650687" watchObservedRunningTime="2026-10-30 06:55:59.505607771 +0000 UTC m=+4.742277672"
Oct 30 06:56:00.307887 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:00.307798    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:00.308334 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:00.307953    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:00.450348 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:00.450310    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"747e6823a71c3697d810e3c5e2c39baa","Type":"ContainerStarted","Data":"66ad923316b06dfb04da18ebfb5171667dc76d4e8f75d26e123842213134d8d1"}
Oct 30 06:56:00.937074 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:00.936313    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:00.937074 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:00.936388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:00.937074 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:00.936554    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 06:56:00.937074 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:00.936610    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret podName:a45a4f45-8253-4317-82ca-9edf34f33dbd nodeName:}" failed. No retries permitted until 2026-10-30 06:56:04.936593725 +0000 UTC m=+10.173263607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret") pod "global-pull-secret-syncer-mvld4" (UID: "a45a4f45-8253-4317-82ca-9edf34f33dbd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 06:56:00.937074 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:00.936998    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:56:00.937074 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:00.937048    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:56:04.9370326 +0000 UTC m=+10.173702482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:56:01.037005 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:01.036972    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:01.037205 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:01.037181    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 06:56:01.037271 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:01.037213    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 06:56:01.037271 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:01.037227    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ps8pz for pod openshift-network-diagnostics/network-check-target-jlk9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:56:01.037377 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:01.037291    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz podName:bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b nodeName:}" failed. No retries permitted until 2026-10-30 06:56:05.037271163 +0000 UTC m=+10.273941043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps8pz" (UniqueName: "kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz") pod "network-check-target-jlk9l" (UID: "bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:56:01.309477 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:01.308954    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:01.309477 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:01.308970    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:01.309477 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:01.309089    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:01.309477 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:01.309210    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:01.459487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:01.459450    2584 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="3229b46cc5ae497fd7df3dea2806c1a1c4f829e0227cd6acf5f5b5691d758e43" exitCode=0
Oct 30 06:56:01.460534 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:01.460508    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerDied","Data":"3229b46cc5ae497fd7df3dea2806c1a1c4f829e0227cd6acf5f5b5691d758e43"}
Oct 30 06:56:01.538435 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:01.537887    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" podStartSLOduration=5.537865146 podStartE2EDuration="5.537865146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:00.493691918 +0000 UTC m=+5.730361816" watchObservedRunningTime="2026-10-30 06:56:01.537865146 +0000 UTC m=+6.774535042"
Oct 30 06:56:02.308244 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:02.307717    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:02.308244 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:02.307867    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:02.470821 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:02.470186    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thvhj" event={"ID":"b23a23e6-395f-4501-aab1-be26e3ff2236","Type":"ContainerStarted","Data":"c66b2010bbe6af8d691429a9679ee4e55f55f5381a7e26b5eded1e36761170d3"}
Oct 30 06:56:02.512953 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:02.512081    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-thvhj" podStartSLOduration=2.461997788 podStartE2EDuration="6.512061498s" totalImagesPullingTime="4.05006371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:02.51171576 +0000 UTC m=+7.748385657" watchObservedRunningTime="2026-10-30 06:56:02.512061498 +0000 UTC m=+7.748731396"
Oct 30 06:56:03.275476 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:03.275438    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:03.309351 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:03.309317    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:03.309504 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:03.309443    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:03.309844 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:03.309822    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:03.309956 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:03.309927    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:03.476303 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:03.476267    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fnh8d" event={"ID":"dae48309-e15e-4919-a6d3-051758b7a23e","Type":"ContainerStarted","Data":"48c995d15e52ab3a20d6a6d10544876b4ce4a319eb363f71f85636fced6507e2"}
Oct 30 06:56:03.517172 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:03.517119    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fnh8d" podStartSLOduration=3.535176804 podStartE2EDuration="8.517105203s" totalImagesPullingTime="4.981928399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:03.516966779 +0000 UTC m=+8.753636676" watchObservedRunningTime="2026-10-30 06:56:03.517105203 +0000 UTC m=+8.753775100"
Oct 30 06:56:04.308032 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:04.307999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:04.308210 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:04.308132    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:04.480718 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:04.480685    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j" event={"ID":"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4","Type":"ContainerStarted","Data":"b59c5b58af8cde571300c098f45e38f851afbd0e7711541ddda14b9fc7828c1f"}
Oct 30 06:56:04.970104 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:04.970037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:04.970181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:04.970114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:04.970264 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:04.970241    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:56:04.970335 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:04.970312    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:56:12.970294853 +0000 UTC m=+18.206964748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:56:04.970411 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:04.970382    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 06:56:04.970462 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:04.970420    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret podName:a45a4f45-8253-4317-82ca-9edf34f33dbd nodeName:}" failed. No retries permitted until 2026-10-30 06:56:12.970407948 +0000 UTC m=+18.207077835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret") pod "global-pull-secret-syncer-mvld4" (UID: "a45a4f45-8253-4317-82ca-9edf34f33dbd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 06:56:05.071501 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.071468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:05.072130 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:05.071640    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 06:56:05.072130 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:05.071668    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 06:56:05.072130 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:05.071682    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ps8pz for pod openshift-network-diagnostics/network-check-target-jlk9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:56:05.072130 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:05.071740    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz podName:bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b nodeName:}" failed. No retries permitted until 2026-10-30 06:56:13.071722861 +0000 UTC m=+18.308392751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps8pz" (UniqueName: "kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz") pod "network-check-target-jlk9l" (UID: "bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:56:05.156624 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.155789    2584 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 06:56:05.260055 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.259963    2584 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T06:56:05.155809543Z","UUID":"d8ad3807-5f7d-4c3b-87bb-d65485a476b7","Handler":null,"Name":"","Endpoint":""}
Oct 30 06:56:05.264168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.264148    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 06:56:05.264260 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.264177    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 06:56:05.309585 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.309555    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:05.309679 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:05.309661    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:05.309998 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.309969    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:05.310896 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:05.310868    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:05.485090 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.485001    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j" event={"ID":"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4","Type":"ContainerStarted","Data":"dbaf35fe8414c3a48cb31e5a3aafc11bdeb877006fb09e5ee3b44cc3328e6f43"}
Oct 30 06:56:05.487420 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:05.486882    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2snxl" event={"ID":"04664ebb-d94a-4bfe-a346-b441a7da0e3f","Type":"ContainerStarted","Data":"33a9f45f8fe49cd09d113653857dad87396f31974261159d46b7243131a5b368"}
Oct 30 06:56:06.308656 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.307992    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:06.308656 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:06.308302    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:06.321357 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.321322    2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:06.322140 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.322113    2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:06.363793 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.363703    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-2snxl" podStartSLOduration=4.076504805 podStartE2EDuration="11.363689387s" totalImagesPullingTime="7.287184582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:05.532659929 +0000 UTC m=+10.769329841" watchObservedRunningTime="2026-10-30 06:56:06.363689387 +0000 UTC m=+11.600359284"
Oct 30 06:56:06.490778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.490748    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kg9qk" event={"ID":"334689c1-93d2-4b74-8d46-20890f606782","Type":"ContainerStarted","Data":"735932b852a64b854a456b04cd7be8481df66626adbb201d17f998fb9fa56713"}
Oct 30 06:56:06.493045 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.492958    2584 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="d23e3a943391b8b381020ab3f033dfcc9992752f310152741ea3f83e26ed9476" exitCode=0
Oct 30 06:56:06.493158 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.493053    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerDied","Data":"d23e3a943391b8b381020ab3f033dfcc9992752f310152741ea3f83e26ed9476"}
Oct 30 06:56:06.495550 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.495523    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j" event={"ID":"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4","Type":"ContainerStarted","Data":"8b1457df3e26c5a9c788f72a862448cf5fd0255969494a47487981e5a362042d"}
Oct 30 06:56:06.496648 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.496631    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:06.533353 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:06.533301    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-kg9qk" podStartSLOduration=3.576823241 podStartE2EDuration="11.533283549s" totalImagesPullingTime="7.956460308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:06.532558074 +0000 UTC m=+11.769227971" watchObservedRunningTime="2026-10-30 06:56:06.533283549 +0000 UTC m=+11.769953449"
Oct 30 06:56:07.308231 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.308168    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:07.308369 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:07.308333    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:07.308424 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.308354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:07.308638 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:07.308608    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:07.499868 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.499816    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6pb4" event={"ID":"580c167c-2e1f-4dbd-86b2-4412e856f1c2","Type":"ContainerStarted","Data":"aadbabea628a12cf584d5567627029657746d04d97237e283177d0b8425539ac"}
Oct 30 06:56:07.502103 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.502077    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvtgp" event={"ID":"f38e4bfa-c76a-459a-b0c2-2f731ca919fc","Type":"ContainerStarted","Data":"37385f20397f1380b503aa939bdb927bed9c7629582f2ee3266e5e74706c7f26"}
Oct 30 06:56:07.504268 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.504239    2584 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="63e36f66d8c0e7eeacaf67266c46f39ebdb721db0b42702d03cfa2d6c780452b" exitCode=0
Oct 30 06:56:07.504348 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.504324    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerDied","Data":"63e36f66d8c0e7eeacaf67266c46f39ebdb721db0b42702d03cfa2d6c780452b"}
Oct 30 06:56:07.540496 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.540455    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j" podStartSLOduration=4.434843073 podStartE2EDuration="12.540439626s" totalImagesPullingTime="8.105596553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:06.67396891 +0000 UTC m=+11.910638808" watchObservedRunningTime="2026-10-30 06:56:07.540439626 +0000 UTC m=+12.777109525"
Oct 30 06:56:07.540736 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.540704    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p6pb4" podStartSLOduration=4.86093385 podStartE2EDuration="12.540696004s" totalImagesPullingTime="7.679762154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:07.540125913 +0000 UTC m=+12.776795980" watchObservedRunningTime="2026-10-30 06:56:07.540696004 +0000 UTC m=+12.777365905"
Oct 30 06:56:07.631985 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:07.631897    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hvtgp" podStartSLOduration=2.861642166 podStartE2EDuration="12.631883876s" totalImagesPullingTime="9.77024171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:07.631181377 +0000 UTC m=+12.867851274" watchObservedRunningTime="2026-10-30 06:56:07.631883876 +0000 UTC m=+12.868553772"
Oct 30 06:56:08.307985 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:08.307945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:08.308144 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:08.308061    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:08.510005 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:08.509973    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerStarted","Data":"e0df243979514b1a3dda8be7dc4aad29d24814a8f7b0ffe40084f28e5b7146d6"}
Oct 30 06:56:09.308108 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:09.308072    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:09.308108 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:09.308115    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:09.308310 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:09.308216    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:09.308412 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:09.308373    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:09.514512 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:09.514476    2584 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="e0df243979514b1a3dda8be7dc4aad29d24814a8f7b0ffe40084f28e5b7146d6" exitCode=0
Oct 30 06:56:09.515108 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:09.514529    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerDied","Data":"e0df243979514b1a3dda8be7dc4aad29d24814a8f7b0ffe40084f28e5b7146d6"}
Oct 30 06:56:10.307481 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:10.307252    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:10.307644 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:10.307565    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:11.307215 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:11.307180    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:11.307625 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:11.307297    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:11.307625 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:11.307345    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:11.307625 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:11.307434    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:12.307551 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.307528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:12.307877 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:12.307618    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:12.522533 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.522383    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"5e3d0382377a27b6143c3155a0251baa29efc29080d5ad6fca696dfe904b531c"}
Oct 30 06:56:12.522633 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.522576    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"a04a15220771169db9a0dc80b2fd827cb81112fe19656a31be051e124bd7cd2f"}
Oct 30 06:56:12.522633 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.522611    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"0673bea2ffe8f7b0e23d076ab71d44caf3c2a5a0a449696837c0aaa2ce0f50fc"}
Oct 30 06:56:12.522734 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.522640    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"8998d4467c91d65b0c774e588a59026fca28f6af53094bb0fbba3fc181e74c9a"}
Oct 30 06:56:12.522734 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.522673    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"4985e25d945c07d23583b7d6236e5a47c2385fbf1a8210c8d0ef12513152186b"}
Oct 30 06:56:12.525017 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.524996    2584 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="9599b679b6bb7e51b2ed4e436e3b012a931613c4887b0bd28e5d3a14334a21a5" exitCode=0
Oct 30 06:56:12.525102 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:12.525029    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerDied","Data":"9599b679b6bb7e51b2ed4e436e3b012a931613c4887b0bd28e5d3a14334a21a5"}
Oct 30 06:56:13.031216 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.031184    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:13.031383 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.031236    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:13.031383 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.031329    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 06:56:13.031383 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.031340    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:56:13.031383 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.031379    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret podName:a45a4f45-8253-4317-82ca-9edf34f33dbd nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.031367371 +0000 UTC m=+34.268037246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret") pod "global-pull-secret-syncer-mvld4" (UID: "a45a4f45-8253-4317-82ca-9edf34f33dbd") : object "kube-system"/"original-pull-secret" not registered
Oct 30 06:56:13.031552 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.031403    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.031384547 +0000 UTC m=+34.268054430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 06:56:13.131539 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.131508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:13.131681 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.131663    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 06:56:13.131715 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.131685    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 06:56:13.131715 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.131696    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ps8pz for pod openshift-network-diagnostics/network-check-target-jlk9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:56:13.131797 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.131744    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz podName:bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.131730599 +0000 UTC m=+34.368400473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ps8pz" (UniqueName: "kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz") pod "network-check-target-jlk9l" (UID: "bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 06:56:13.308173 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.308092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:13.308797 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.308270    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:13.308797 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.308294    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:13.308797 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:13.308375    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:13.529696 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.529663    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"ec4e81c7354c485a7f98a0874cc8a4865c5ae85e9896d37bff33d9578662a266"}
Oct 30 06:56:13.532457 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.532432    2584 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="3c616ea2bf45c1dddccddf85d2764a9d843b565f0afb30d1a8ba1152ce6d76d1" exitCode=0
Oct 30 06:56:13.532558 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:13.532465    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerDied","Data":"3c616ea2bf45c1dddccddf85d2764a9d843b565f0afb30d1a8ba1152ce6d76d1"}
Oct 30 06:56:14.308092 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:14.308051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:14.308276 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:14.308160    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:14.538163 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:14.538132    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" event={"ID":"46375128-278b-46e4-ace2-13374ad65d23","Type":"ContainerStarted","Data":"fc5bab21f272409de0bd9472cfeffc7a3281007e694a9f1d8e2fb33d3a6e29be"}
Oct 30 06:56:14.613497 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:14.613455    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qn9r5" podStartSLOduration=9.070448046 podStartE2EDuration="19.613440211s" totalImagesPullingTime="10.542992165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:14.612814696 +0000 UTC m=+19.849484593" watchObservedRunningTime="2026-10-30 06:56:14.613440211 +0000 UTC m=+19.850110108"
Oct 30 06:56:15.308248 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:15.308214    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:15.308422 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:15.308290    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:15.308422 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:15.308375    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:15.308969 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:15.308465    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:15.543309 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:15.543273    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"4eaea4501d916e44f683e7666e0fa6bf9189579177c29bd99d352d5b582caa68"}
Oct 30 06:56:16.307998 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:16.307966    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:16.308171 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:16.308064    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:17.308209 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:17.308030    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:17.308791 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:17.308055    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:17.308791 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:17.308286    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:17.308791 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:17.308349    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:17.551669 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:17.551637    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" event={"ID":"f1c149b5-13ba-423f-a970-98da3c328798","Type":"ContainerStarted","Data":"9352c06879c7f7bfed336809e96909114eab607b670ceca9d0e38708765454cd"}
Oct 30 06:56:17.551893 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:17.551876    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:17.567201 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:17.567145    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:17.647447 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:17.647394    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp" podStartSLOduration=7.968219719 podStartE2EDuration="22.647381637s" totalImagesPullingTime="14.679161918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 06:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:17.647079991 +0000 UTC m=+22.883749888" watchObservedRunningTime="2026-10-30 06:56:17.647381637 +0000 UTC m=+22.884051534"
Oct 30 06:56:18.307510 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.307479    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:18.307650 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:18.307579    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:18.554421 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.554396    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:18.554761 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.554467    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:18.569101 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.569047    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:18.789239 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.789209    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mvld4"]
Oct 30 06:56:18.789496 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.789367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:18.789496 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:18.789446    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:18.792398 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.792362    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jlk9l"]
Oct 30 06:56:18.792653 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.792634    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:18.792749 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:18.792716    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:18.793509 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.793480    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-76th7"]
Oct 30 06:56:18.793600 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:18.793580    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:18.793700 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:18.793672    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:20.307305 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:20.307268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:20.307697 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:20.307316    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:20.307697 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:20.307268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:20.307697 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:20.307372    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:20.307697 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:20.307453    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:20.307697 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:20.307516    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:22.308085 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:22.308048    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:22.308715 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:22.308048    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:22.308715 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:22.308178    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:22.308715 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:22.308048    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:22.308715 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:22.308226    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:22.308715 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:22.308293    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:24.307547 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:24.307515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:24.307979 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:24.307642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:24.307979 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:24.307661    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mvld4" podUID="a45a4f45-8253-4317-82ca-9edf34f33dbd"
Oct 30 06:56:24.307979 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:24.307717    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-76th7" podUID="497c3d29-4ad7-4314-b73a-8015ea05057f"
Oct 30 06:56:24.307979 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:24.307748    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:24.307979 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:24.307831    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jlk9l" podUID="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b"
Oct 30 06:56:25.568359 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.568295    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeReady"
Oct 30 06:56:25.568776 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.568401    2584 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 06:56:25.617336 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.617304    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8ghnm"]
Oct 30 06:56:25.660641 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.660599    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-rns6c"]
Oct 30 06:56:25.661814 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.661781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:25.677798 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.677770    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.677999 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.677981    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.679362 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.679338    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-789654ff5-xkswj"]
Oct 30 06:56:25.679473 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.679455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:25.689546 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.689523    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-9x2q4"]
Oct 30 06:56:25.689633 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.689608    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.705599 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.705564    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 06:56:25.705685 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.705663    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 06:56:25.705685 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.705673    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 06:56:25.712758 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.712740    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-b7r65"]
Oct 30 06:56:25.712875 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.712847    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:25.727566 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.727545    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"]
Oct 30 06:56:25.727660 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.727647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:25.737284 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.737267    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8b55fb966-6lrtj"]
Oct 30 06:56:25.737385 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.737371    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.761050 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.761028    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-95gsq"]
Oct 30 06:56:25.761136 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.761125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.778802 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.778775    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.778802 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.778781    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.778802 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.778800    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.778986 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.778932    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 06:56:25.778986 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.778936    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.778986 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.778959    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 06:56:25.783094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.783080    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"]
Oct 30 06:56:25.783169 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.783150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.792824 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.792805    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 06:56:25.793493 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.793479    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 06:56:25.805813 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.805790    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 06:56:25.805933 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.805916    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 06:56:25.806001 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.805921    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 06:56:25.806001 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.805914    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 06:56:25.806001 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.805988    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 06:56:25.806138 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.806060    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 06:56:25.806138 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.806070    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-k58xb\""
Oct 30 06:56:25.806196 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.806179    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-m59nb"]
Oct 30 06:56:25.806294 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.806281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:25.821765 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.821728    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 06:56:25.824014 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-stats-auth\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.824084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824023    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.824084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqk66\" (UniqueName: \"kubernetes.io/projected/9e54b74c-ba81-405b-9002-c7ff8719e93d-kube-api-access-dqk66\") pod \"kas-connection-checker-685895c7c9-rns6c\" (UID: \"9e54b74c-ba81-405b-9002-c7ff8719e93d\") " pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:25.824084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824063    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mts4p\" (UniqueName: \"kubernetes.io/projected/8d16b2df-cd08-4dd3-a1b3-88274a827068-kube-api-access-mts4p\") pod \"kas-connection-checker-685895c7c9-8ghnm\" (UID: \"8d16b2df-cd08-4dd3-a1b3-88274a827068\") " pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:25.824084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2dp\" (UniqueName: \"kubernetes.io/projected/099c00ac-0c53-4bd5-be8f-de38e33f705e-kube-api-access-5v2dp\") pod \"kas-connection-checker-685895c7c9-9x2q4\" (UID: \"099c00ac-0c53-4bd5-be8f-de38e33f705e\") " pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:25.824277 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-default-certificate\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.824318 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.824351 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.824390 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824353    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc6w6\" (UniqueName: \"kubernetes.io/projected/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-kube-api-access-xc6w6\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.824390 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acb49735-f2be-44e2-92f2-65f68a386864-nginx-conf\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:25.824491 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:25.824491 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.824575 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.824487    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfg2\" (UniqueName: \"kubernetes.io/projected/5d01ad1b-d546-48f6-b5b8-980de74eb623-kube-api-access-lrfg2\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.826362 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.826339    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l6xts"]
Oct 30 06:56:25.826452 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.826406    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:25.847726 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.847704    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"]
Oct 30 06:56:25.847821 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.847802    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:25.862143 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.862127    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"]
Oct 30 06:56:25.862259 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.862243    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:25.874631 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.874614    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b74f6655f-cf7cw"]
Oct 30 06:56:25.874737 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.874724    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:25.879011 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.878986    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 06:56:25.879011 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.878976    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 06:56:25.879215 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879048    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.879215 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879056    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.879215 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879072    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.879215 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879117    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.879215 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879135    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 06:56:25.879687 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879672    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.879769 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879705    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.879817 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879768    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.879817 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879776    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 06:56:25.879912 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.879885    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.880836 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.880812    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 06:56:25.880980 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.880834    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"]
Oct 30 06:56:25.881135 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.880939    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:25.883419 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.883397    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 06:56:25.887949 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.887929    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xghrm"]
Oct 30 06:56:25.888029 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.888017    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:25.892491 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.892472    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 06:56:25.892491 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.892488    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.892636 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.892503    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.901367 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.901345    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"]
Oct 30 06:56:25.901474 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.901459    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:25.903746 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.903730    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 06:56:25.903813 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.903747    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.903813 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.903778    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.906328 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.906307    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 06:56:25.906405 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.906367    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 06:56:25.906538 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.906522    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 06:56:25.906590 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.906549    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pptc7\""
Oct 30 06:56:25.906590 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.906526    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 06:56:25.906661 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.906599    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6mxg\""
Oct 30 06:56:25.915712 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915697    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8ghnm"]
Oct 30 06:56:25.915785 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915723    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-rns6c"]
Oct 30 06:56:25.915785 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915740    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-789654ff5-xkswj"]
Oct 30 06:56:25.915785 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915753    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"]
Oct 30 06:56:25.915785 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915767    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"]
Oct 30 06:56:25.915785 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915780    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-95gsq"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915792    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-b7r65"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915882    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915896    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915910    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915928    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b74f6655f-cf7cw"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915942    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915961    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-9x2q4"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915974    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6xts"]
Oct 30 06:56:25.915997 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.915989    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8b55fb966-6lrtj"]
Oct 30 06:56:25.916294 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.916006    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-m59nb"]
Oct 30 06:56:25.916294 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.916026    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xghrm"]
Oct 30 06:56:25.917442 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.917427    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-dpx9k\""
Oct 30 06:56:25.925312 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925295    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-snapshots\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.925385 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.925385 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10492054-f044-4bee-93c4-e316fc500bff-tmp-dir\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:25.925385 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925360    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:25.925486 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925411    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.925486 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-serving-cert\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:25.925486 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10492054-f044-4bee-93c4-e316fc500bff-config-volume\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:25.925577 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925527    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chsqg\" (UniqueName: \"kubernetes.io/projected/96156c02-8e1f-4612-b919-b20007fe0dda-kube-api-access-chsqg\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.925577 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.925538    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 06:56:25.925577 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:25.925659 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.925585    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert podName:acb49735-f2be-44e2-92f2-65f68a386864 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.425571726 +0000 UTC m=+31.662241604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-b7r65" (UID: "acb49735-f2be-44e2-92f2-65f68a386864") : secret "networking-console-plugin-cert" not found
Oct 30 06:56:25.925659 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5255\" (UniqueName: \"kubernetes.io/projected/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-kube-api-access-s5255\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:25.925659 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.925760 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925691    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-config\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:25.925760 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925715    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8vf7\" (UniqueName: \"kubernetes.io/projected/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-kube-api-access-h8vf7\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:25.925816 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.925816 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-trusted-ca\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:25.925901 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925846    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-tmp\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.925933 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-service-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.925933 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925928    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acb49735-f2be-44e2-92f2-65f68a386864-nginx-conf\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:25.925990 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.925990 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925960    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96156c02-8e1f-4612-b919-b20007fe0dda-serving-cert\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.926043 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.925986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-serving-cert\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:25.926043 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.926036    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:25.926101 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfg2\" (UniqueName: \"kubernetes.io/projected/5d01ad1b-d546-48f6-b5b8-980de74eb623-kube-api-access-lrfg2\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.926156 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.926143    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls podName:df38da75-f716-4dd4-a6eb-f736d0d2ac6c nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.426127723 +0000 UTC m=+31.662797612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-88z7x" (UID: "df38da75-f716-4dd4-a6eb-f736d0d2ac6c") : secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:25.926211 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.926243 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926232    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.926274 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.926304 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhntt\" (UniqueName: \"kubernetes.io/projected/10492054-f044-4bee-93c4-e316fc500bff-kube-api-access-zhntt\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:25.926338 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926304    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-stats-auth\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.926338 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqk66\" (UniqueName: \"kubernetes.io/projected/9e54b74c-ba81-405b-9002-c7ff8719e93d-kube-api-access-dqk66\") pod \"kas-connection-checker-685895c7c9-rns6c\" (UID: \"9e54b74c-ba81-405b-9002-c7ff8719e93d\") " pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:25.926395 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-config\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:25.926426 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926403    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mts4p\" (UniqueName: \"kubernetes.io/projected/8d16b2df-cd08-4dd3-a1b3-88274a827068-kube-api-access-mts4p\") pod \"kas-connection-checker-685895c7c9-8ghnm\" (UID: \"8d16b2df-cd08-4dd3-a1b3-88274a827068\") " pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:25.926574 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:25.926665 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926602    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acb49735-f2be-44e2-92f2-65f68a386864-nginx-conf\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:25.926665 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926603    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.926665 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2dp\" (UniqueName: \"kubernetes.io/projected/099c00ac-0c53-4bd5-be8f-de38e33f705e-kube-api-access-5v2dp\") pod \"kas-connection-checker-685895c7c9-9x2q4\" (UID: \"099c00ac-0c53-4bd5-be8f-de38e33f705e\") " pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:25.926786 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:25.926786 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-default-certificate\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.926786 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.926786 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc6w6\" (UniqueName: \"kubernetes.io/projected/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-kube-api-access-xc6w6\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.926970 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.926970 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.926891    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.426874183 +0000 UTC m=+31.663544079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : configmap references non-existent config key: service-ca.crt
Oct 30 06:56:25.926970 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.926892    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 06:56:25.926970 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.926916    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.926970 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:25.926939    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.426927391 +0000 UTC m=+31.663597266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : secret "router-metrics-certs-default" not found
Oct 30 06:56:25.929913 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.929893    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-default-certificate\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.929913 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.929900    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-stats-auth\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.950699 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.950672    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfg2\" (UniqueName: \"kubernetes.io/projected/5d01ad1b-d546-48f6-b5b8-980de74eb623-kube-api-access-lrfg2\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:25.951014 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.950992    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2dp\" (UniqueName: \"kubernetes.io/projected/099c00ac-0c53-4bd5-be8f-de38e33f705e-kube-api-access-5v2dp\") pod \"kas-connection-checker-685895c7c9-9x2q4\" (UID: \"099c00ac-0c53-4bd5-be8f-de38e33f705e\") " pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:25.951335 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.951318    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc6w6\" (UniqueName: \"kubernetes.io/projected/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-kube-api-access-xc6w6\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:25.951435 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.951410    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqk66\" (UniqueName: \"kubernetes.io/projected/9e54b74c-ba81-405b-9002-c7ff8719e93d-kube-api-access-dqk66\") pod \"kas-connection-checker-685895c7c9-rns6c\" (UID: \"9e54b74c-ba81-405b-9002-c7ff8719e93d\") " pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:25.951534 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.951518    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mts4p\" (UniqueName: \"kubernetes.io/projected/8d16b2df-cd08-4dd3-a1b3-88274a827068-kube-api-access-mts4p\") pod \"kas-connection-checker-685895c7c9-8ghnm\" (UID: \"8d16b2df-cd08-4dd3-a1b3-88274a827068\") " pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:25.981796 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.981765    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.981937 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.981921    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.981993 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.981942    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 06:56:25.982059 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.982043    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 06:56:25.986115 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:25.986100    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:26.003585 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.003565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:26.007541 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.007523    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 06:56:26.027647 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.027623    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-snapshots\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.027744 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.027652    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vdm\" (UniqueName: \"kubernetes.io/projected/a733e34a-1603-4bd5-8ef0-5ff872027fa6-kube-api-access-r9vdm\") pod \"volume-data-source-validator-58c9f5f46d-hk42v\" (UID: \"a733e34a-1603-4bd5-8ef0-5ff872027fa6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:26.027744 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.027672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.027744 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.027692    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9px\" (UniqueName: \"kubernetes.io/projected/88abcbca-0455-472c-ab5a-6bd2a50d4544-kube-api-access-kz9px\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.027744 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.027716    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.027926 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.027910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10492054-f044-4bee-93c4-e316fc500bff-tmp-dir\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.028026 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028007    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.028061 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-serving-cert\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.028092 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10492054-f044-4bee-93c4-e316fc500bff-config-volume\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.028130 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88abcbca-0455-472c-ab5a-6bd2a50d4544-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.028174 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a361442-634d-4ff5-990a-29095aa6264d-cert\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.028174 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chsqg\" (UniqueName: \"kubernetes.io/projected/96156c02-8e1f-4612-b919-b20007fe0dda-kube-api-access-chsqg\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.028273 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028213    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-snapshots\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.028273 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.028273 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028216    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10492054-f044-4bee-93c4-e316fc500bff-tmp-dir\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.028273 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028285    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5255\" (UniqueName: \"kubernetes.io/projected/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-kube-api-access-s5255\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.028319    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028327    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-config\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.028380    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.52835392 +0000 UTC m=+31.765023812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.028429    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:26.028466 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.028444    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.028485    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.528469794 +0000 UTC m=+31.765139690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vf7\" (UniqueName: \"kubernetes.io/projected/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-kube-api-access-h8vf7\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028591    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-trusted-ca\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cwg\" (UniqueName: \"kubernetes.io/projected/95661150-16a9-4b3a-9660-9ad8feaa09a9-kube-api-access-f6cwg\") pod \"network-check-source-6f78d59f99-d2vr7\" (UID: \"95661150-16a9-4b3a-9660-9ad8feaa09a9\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028681    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10492054-f044-4bee-93c4-e316fc500bff-config-volume\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028701    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.028789 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-tmp\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-service-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028928    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88abcbca-0455-472c-ab5a-6bd2a50d4544-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.028958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5g9l\" (UniqueName: \"kubernetes.io/projected/e34614b0-e9e0-48fa-ae70-99404431cc66-kube-api-access-z5g9l\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029033    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029063    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-config\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.029181 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029082    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96156c02-8e1f-4612-b919-b20007fe0dda-serving-cert\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-serving-cert\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhntt\" (UniqueName: \"kubernetes.io/projected/10492054-f044-4bee-93c4-e316fc500bff-kube-api-access-zhntt\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-config\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029426    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.029487 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029485    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029546    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-service-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029585    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029588    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chrf4\" (UniqueName: \"kubernetes.io/projected/3a361442-634d-4ff5-990a-29095aa6264d-kube-api-access-chrf4\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029648    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-trusted-ca\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.029927 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.029892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:26.030408 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.030384    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.030921 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.030897    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.031014 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.030964    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.031084 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.031050    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-config\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.031138 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.031105    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.031228 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.031200    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-tmp\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.031576 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.031479    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-serving-cert\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.033073 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.033037    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.035208 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.035190    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-serving-cert\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.035325 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.035303    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96156c02-8e1f-4612-b919-b20007fe0dda-serving-cert\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.053749 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.053683    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.055778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.055753    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5255\" (UniqueName: \"kubernetes.io/projected/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-kube-api-access-s5255\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.056377 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.056338    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vf7\" (UniqueName: \"kubernetes.io/projected/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-kube-api-access-h8vf7\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.057012 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.056967    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chsqg\" (UniqueName: \"kubernetes.io/projected/96156c02-8e1f-4612-b919-b20007fe0dda-kube-api-access-chsqg\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.057980 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.057418    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.057980 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.057870    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhntt\" (UniqueName: \"kubernetes.io/projected/10492054-f044-4bee-93c4-e316fc500bff-kube-api-access-zhntt\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.119115 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.119085    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.134734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.134811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chrf4\" (UniqueName: \"kubernetes.io/projected/3a361442-634d-4ff5-990a-29095aa6264d-kube-api-access-chrf4\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.134890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vdm\" (UniqueName: \"kubernetes.io/projected/a733e34a-1603-4bd5-8ef0-5ff872027fa6-kube-api-access-r9vdm\") pod \"volume-data-source-validator-58c9f5f46d-hk42v\" (UID: \"a733e34a-1603-4bd5-8ef0-5ff872027fa6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.134919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9px\" (UniqueName: \"kubernetes.io/projected/88abcbca-0455-472c-ab5a-6bd2a50d4544-kube-api-access-kz9px\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.134945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.134988    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88abcbca-0455-472c-ab5a-6bd2a50d4544-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.135014    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a361442-634d-4ff5-990a-29095aa6264d-cert\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.135778 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.135719    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88abcbca-0455-472c-ab5a-6bd2a50d4544-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.135820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.135908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.135950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cwg\" (UniqueName: \"kubernetes.io/projected/95661150-16a9-4b3a-9660-9ad8feaa09a9-kube-api-access-f6cwg\") pod \"network-check-source-6f78d59f99-d2vr7\" (UID: \"95661150-16a9-4b3a-9660-9ad8feaa09a9\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.136000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.136027    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.136055    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88abcbca-0455-472c-ab5a-6bd2a50d4544-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.136078    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.136237    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.136347    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.136422    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls podName:e34614b0-e9e0-48fa-ae70-99404431cc66 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.63640195 +0000 UTC m=+31.873071849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4gvn9" (UID: "e34614b0-e9e0-48fa-ae70-99404431cc66") : secret "samples-operator-tls" not found
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.137150    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.137798    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5g9l\" (UniqueName: \"kubernetes.io/projected/e34614b0-e9e0-48fa-ae70-99404431cc66-kube-api-access-z5g9l\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.137835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.137917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.138094 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.137949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.139133 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.138289    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:26.139133 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.138307    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:26.139133 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.138356    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:26.638338582 +0000 UTC m=+31.875008470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:26.139133 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.138818    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.139133 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.138942    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:26.139737 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.139514    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.139799 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.139779    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a361442-634d-4ff5-990a-29095aa6264d-cert\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.143415 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.143023    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.143415 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.143375    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.144608 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.144589    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88abcbca-0455-472c-ab5a-6bd2a50d4544-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.159446 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.159422    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:26.159888 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.159866    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chrf4\" (UniqueName: \"kubernetes.io/projected/3a361442-634d-4ff5-990a-29095aa6264d-kube-api-access-chrf4\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.161740 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.161703    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vdm\" (UniqueName: \"kubernetes.io/projected/a733e34a-1603-4bd5-8ef0-5ff872027fa6-kube-api-access-r9vdm\") pod \"volume-data-source-validator-58c9f5f46d-hk42v\" (UID: \"a733e34a-1603-4bd5-8ef0-5ff872027fa6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:26.162358 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.162335    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9px\" (UniqueName: \"kubernetes.io/projected/88abcbca-0455-472c-ab5a-6bd2a50d4544-kube-api-access-kz9px\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.163355 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.163335    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.164926 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.164876    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.165373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.165150    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cwg\" (UniqueName: \"kubernetes.io/projected/95661150-16a9-4b3a-9660-9ad8feaa09a9-kube-api-access-f6cwg\") pod \"network-check-source-6f78d59f99-d2vr7\" (UID: \"95661150-16a9-4b3a-9660-9ad8feaa09a9\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:26.165373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.165330    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5g9l\" (UniqueName: \"kubernetes.io/projected/e34614b0-e9e0-48fa-ae70-99404431cc66-kube-api-access-z5g9l\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.185760 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.183581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:26.202786 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.196879    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:26.249783 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.249561    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:26.254561 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.254438    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:26.308131 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.308097    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:26.308804 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.308384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:26.308804 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.308398    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:26.325386 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.325050    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 06:56:26.325386 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.325126    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9hhpl\""
Oct 30 06:56:26.326223 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.325757    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 06:56:26.326223 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.325863    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wlntw\""
Oct 30 06:56:26.326223 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.326051    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hkqzl\""
Oct 30 06:56:26.369948 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.369921    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8ghnm"]
Oct 30 06:56:26.373099 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.372881    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-rns6c"]
Oct 30 06:56:26.373432 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.373407    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d16b2df_cd08_4dd3_a1b3_88274a827068.slice/crio-2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6 WatchSource:0}: Error finding container 2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6: Status 404 returned error can't find the container with id 2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6
Oct 30 06:56:26.374528 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.374505    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e54b74c_ba81_405b_9002_c7ff8719e93d.slice/crio-103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254 WatchSource:0}: Error finding container 103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254: Status 404 returned error can't find the container with id 103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254
Oct 30 06:56:26.382993 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.382973    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099c00ac_0c53_4bd5_be8f_de38e33f705e.slice/crio-ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802 WatchSource:0}: Error finding container ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802: Status 404 returned error can't find the container with id ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802
Oct 30 06:56:26.383223 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.383202    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-9x2q4"]
Oct 30 06:56:26.435772 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.435747    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-95gsq"]
Oct 30 06:56:26.440192 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.440161    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:26.440282 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.440223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:26.440282 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.440264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:26.440447 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.440428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:26.440593 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.440574    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:26.440648 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.440638    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls podName:df38da75-f716-4dd4-a6eb-f736d0d2ac6c nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.440619586 +0000 UTC m=+32.677289463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-88z7x" (UID: "df38da75-f716-4dd4-a6eb-f736d0d2ac6c") : secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:26.441110 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.441082    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.441064369 +0000 UTC m=+32.677734247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : configmap references non-existent config key: service-ca.crt
Oct 30 06:56:26.441212 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.441161    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 06:56:26.441212 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.441194    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.44118479 +0000 UTC m=+32.677854665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : secret "router-metrics-certs-default" not found
Oct 30 06:56:26.441309 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.441232    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 06:56:26.441309 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.441267    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert podName:acb49735-f2be-44e2-92f2-65f68a386864 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.441255452 +0000 UTC m=+32.677925330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-b7r65" (UID: "acb49735-f2be-44e2-92f2-65f68a386864") : secret "networking-console-plugin-cert" not found
Oct 30 06:56:26.446106 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.446078    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96156c02_8e1f_4612_b919_b20007fe0dda.slice/crio-69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24 WatchSource:0}: Error finding container 69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24: Status 404 returned error can't find the container with id 69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24
Oct 30 06:56:26.463654 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.463629    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"]
Oct 30 06:56:26.506106 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.505962    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-m59nb"]
Oct 30 06:56:26.508329 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.508310    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"]
Oct 30 06:56:26.517840 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.517816    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4c7ef9_3135_44ee_afd2_f49226ff7ba9.slice/crio-3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641 WatchSource:0}: Error finding container 3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641: Status 404 returned error can't find the container with id 3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641
Oct 30 06:56:26.518179 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.518162    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda733e34a_1603_4bd5_8ef0_5ff872027fa6.slice/crio-ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b WatchSource:0}: Error finding container ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b: Status 404 returned error can't find the container with id ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b
Oct 30 06:56:26.531033 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.530532    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"]
Oct 30 06:56:26.531643 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.531616    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88abcbca_0455_472c_ab5a_6bd2a50d4544.slice/crio-ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484 WatchSource:0}: Error finding container ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484: Status 404 returned error can't find the container with id ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484
Oct 30 06:56:26.541751 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.541728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:26.541904 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.541889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:26.541992 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.541979    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:26.542047 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.542017    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.542006792 +0000 UTC m=+32.778676680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:26.542115 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.542060    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:26.542115 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.542068    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:26.542115 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.542087    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.542080883 +0000 UTC m=+32.778750758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:26.571953 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.571932    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" event={"ID":"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9","Type":"ContainerStarted","Data":"3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641"}
Oct 30 06:56:26.573481 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.573456    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh" event={"ID":"88abcbca-0455-472c-ab5a-6bd2a50d4544","Type":"ContainerStarted","Data":"ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484"}
Oct 30 06:56:26.577961 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.577940    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xghrm"]
Oct 30 06:56:26.578203 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.578182    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb" event={"ID":"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792","Type":"ContainerStarted","Data":"084aaf720ff93c80ccbb8d0d60f7183a68339cc4a93d286b7ee202bfb8eed100"}
Oct 30 06:56:26.579430 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.579408    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-95gsq" event={"ID":"96156c02-8e1f-4612-b919-b20007fe0dda","Type":"ContainerStarted","Data":"69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24"}
Oct 30 06:56:26.580826 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.580805    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-rns6c" event={"ID":"9e54b74c-ba81-405b-9002-c7ff8719e93d","Type":"ContainerStarted","Data":"10efeb8867c9aa65a660b4ccd00f3ab458916c6e5948bf15101555f1639cba0c"}
Oct 30 06:56:26.580937 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.580839    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-rns6c" event={"ID":"9e54b74c-ba81-405b-9002-c7ff8719e93d","Type":"ContainerStarted","Data":"103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254"}
Oct 30 06:56:26.582258 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.582237    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-8ghnm" event={"ID":"8d16b2df-cd08-4dd3-a1b3-88274a827068","Type":"ContainerStarted","Data":"ccb3753b284ce3bfb93509c5e909a141003202762d6c1e80a739d12be8ea7a9a"}
Oct 30 06:56:26.582337 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.582271    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-8ghnm" event={"ID":"8d16b2df-cd08-4dd3-a1b3-88274a827068","Type":"ContainerStarted","Data":"2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6"}
Oct 30 06:56:26.583666 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.583633    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-9x2q4" event={"ID":"099c00ac-0c53-4bd5-be8f-de38e33f705e","Type":"ContainerStarted","Data":"b415e6dff1a2d2a518219d145c436c2b4f49a9d5d6f09570d31e19ae8b7aefeb"}
Oct 30 06:56:26.583768 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.583672    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-9x2q4" event={"ID":"099c00ac-0c53-4bd5-be8f-de38e33f705e","Type":"ContainerStarted","Data":"ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802"}
Oct 30 06:56:26.584840 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.584820    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v" event={"ID":"a733e34a-1603-4bd5-8ef0-5ff872027fa6","Type":"ContainerStarted","Data":"ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b"}
Oct 30 06:56:26.601705 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.601684    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"]
Oct 30 06:56:26.603566 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:26.603547    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95661150_16a9_4b3a_9660_9ad8feaa09a9.slice/crio-249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9 WatchSource:0}: Error finding container 249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9: Status 404 returned error can't find the container with id 249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9
Oct 30 06:56:26.622547 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.622510    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-rns6c" podStartSLOduration=400.622498458 podStartE2EDuration="6m40.622498458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:26.622231557 +0000 UTC m=+31.858901455" watchObservedRunningTime="2026-10-30 06:56:26.622498458 +0000 UTC m=+31.859168351"
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.643372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.643436    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.643702    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.643717    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.643780    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.643763806 +0000 UTC m=+32.880433697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.643881    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 06:56:26.645879 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:26.643979    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls podName:e34614b0-e9e0-48fa-ae70-99404431cc66 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:27.643944603 +0000 UTC m=+32.880614508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4gvn9" (UID: "e34614b0-e9e0-48fa-ae70-99404431cc66") : secret "samples-operator-tls" not found
Oct 30 06:56:26.663888 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.663839    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-9x2q4" podStartSLOduration=400.663827718 podStartE2EDuration="6m40.663827718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:26.662907009 +0000 UTC m=+31.899576931" watchObservedRunningTime="2026-10-30 06:56:26.663827718 +0000 UTC m=+31.900497648"
Oct 30 06:56:26.706838 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:26.706801    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-8ghnm" podStartSLOduration=400.706790117 podStartE2EDuration="6m40.706790117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:26.705667948 +0000 UTC m=+31.942337844" watchObservedRunningTime="2026-10-30 06:56:26.706790117 +0000 UTC m=+31.943460014"
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.451184    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.451262    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.451312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.451346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451522    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451600    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert podName:acb49735-f2be-44e2-92f2-65f68a386864 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.451580156 +0000 UTC m=+34.688250046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-b7r65" (UID: "acb49735-f2be-44e2-92f2-65f68a386864") : secret "networking-console-plugin-cert" not found
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451666    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451702    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls podName:df38da75-f716-4dd4-a6eb-f736d0d2ac6c nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.451690718 +0000 UTC m=+34.688360608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-88z7x" (UID: "df38da75-f716-4dd4-a6eb-f736d0d2ac6c") : secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451767    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.451757127 +0000 UTC m=+34.688427018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : configmap references non-existent config key: service-ca.crt
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451836    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 06:56:27.452221 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.451878    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.451868047 +0000 UTC m=+34.688537941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : secret "router-metrics-certs-default" not found
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.553199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.553241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.553412    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.553428    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.553472    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.553460463 +0000 UTC m=+34.790130350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.553602    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:27.553745 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.553675    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.553658113 +0000 UTC m=+34.790327993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:27.591135 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.590954    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7" event={"ID":"95661150-16a9-4b3a-9660-9ad8feaa09a9","Type":"ContainerStarted","Data":"249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9"}
Oct 30 06:56:27.593759 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.593196    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xghrm" event={"ID":"3a361442-634d-4ff5-990a-29095aa6264d","Type":"ContainerStarted","Data":"74ef3d75fdf13ac9767d6238c8133ad861d58cce320b3d680618b4b838d6260e"}
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.653744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:27.653989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.654127    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.654192    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls podName:e34614b0-e9e0-48fa-ae70-99404431cc66 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.654173358 +0000 UTC m=+34.890843239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4gvn9" (UID: "e34614b0-e9e0-48fa-ae70-99404431cc66") : secret "samples-operator-tls" not found
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.654592    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.654606    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:27.654696 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:27.654650    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:29.654635844 +0000 UTC m=+34.891305719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:29.067289 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.067209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:29.067744 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.067403    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 06:56:29.067744 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.067481    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:57:01.067461977 +0000 UTC m=+66.304131858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : secret "metrics-daemon-secret" not found
Oct 30 06:56:29.067744 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.067409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:29.070213 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.070188    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:29.108205 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.108032    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:29.168962 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.168928    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:29.173272 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.173214    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:29.371946 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.371867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:29.457743 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.455876    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mvld4"]
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.472419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.472558    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.472617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.472650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.472785    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.472840    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.472823474 +0000 UTC m=+38.709493353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : secret "router-metrics-certs-default" not found
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.472927    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.472968    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert podName:acb49735-f2be-44e2-92f2-65f68a386864 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.472954138 +0000 UTC m=+38.709624016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-b7r65" (UID: "acb49735-f2be-44e2-92f2-65f68a386864") : secret "networking-console-plugin-cert" not found
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.473016    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.473039    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls podName:df38da75-f716-4dd4-a6eb-f736d0d2ac6c nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.473031803 +0000 UTC m=+38.709701678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-88z7x" (UID: "df38da75-f716-4dd4-a6eb-f736d0d2ac6c") : secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:29.473213 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.473091    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.473081368 +0000 UTC m=+38.709751260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : configmap references non-existent config key: service-ca.crt
Oct 30 06:56:29.573500 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.573464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:29.573663 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.573511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:29.573801 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.573784    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:29.573866 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.573805    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:29.573919 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.573882    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.57384193 +0000 UTC m=+38.810511809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:29.574256 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.574234    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:29.574346 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.574288    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.574273647 +0000 UTC m=+38.810943524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:29.602241 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.602211    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mvld4" event={"ID":"a45a4f45-8253-4317-82ca-9edf34f33dbd","Type":"ContainerStarted","Data":"f43f97049c89140b34b8b3b6b26b95e2d26af56a5fa2ad31b9ad36a86c87ac2b"}
Oct 30 06:56:29.604299 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.604271    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v" event={"ID":"a733e34a-1603-4bd5-8ef0-5ff872027fa6","Type":"ContainerStarted","Data":"7abcee605765701aa195bcad52d9ff1a7adbe6f0e28c9740fedab98de2ea138b"}
Oct 30 06:56:29.674994 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.674905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:29.674994 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.674948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:29.675204 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.675065    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:29.675204 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.675075    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:29.675204 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.675116    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.675103691 +0000 UTC m=+38.911773567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:29.675440 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.675421    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 06:56:29.675578 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:29.675470    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls podName:e34614b0-e9e0-48fa-ae70-99404431cc66 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.675455568 +0000 UTC m=+38.912125458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4gvn9" (UID: "e34614b0-e9e0-48fa-ae70-99404431cc66") : secret "samples-operator-tls" not found
Oct 30 06:56:29.713760 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.713079    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v" podStartSLOduration=384.511840547 podStartE2EDuration="6m26.713057892s" totalImagesPullingTime="2.201217345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:29.646991144 +0000 UTC m=+34.883661046" watchObservedRunningTime="2026-10-30 06:56:29.713057892 +0000 UTC m=+34.949727791"
Oct 30 06:56:29.714013 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:29.713922    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jlk9l"]
Oct 30 06:56:29.728160 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:29.728133    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0cd3c6_5347_47ef_b81e_6a6c0d5def3b.slice/crio-10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923 WatchSource:0}: Error finding container 10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923: Status 404 returned error can't find the container with id 10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923
Oct 30 06:56:30.611792 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:30.611753    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jlk9l" event={"ID":"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b","Type":"ContainerStarted","Data":"10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923"}
Oct 30 06:56:31.618401 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.618306    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh" event={"ID":"88abcbca-0455-472c-ab5a-6bd2a50d4544","Type":"ContainerStarted","Data":"2711a97697a290c394d12f5548df5356216aefd1e776036376f4e28479a03fc4"}
Oct 30 06:56:31.621981 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.621947    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-95gsq" event={"ID":"96156c02-8e1f-4612-b919-b20007fe0dda","Type":"ContainerStarted","Data":"c27695e7ef975fb9614eb2c35f2b1d1c43d8dd622e0d88d8083bbb182ac8aed3"}
Oct 30 06:56:31.628593 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.628573    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/0.log"
Oct 30 06:56:31.628679 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.628614    2584 generic.go:356] "Generic (PLEG): container finished" podID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" containerID="e30bd2e111003abec72cfaca0728b61700640a11373b9c604a8fe09c88b845da" exitCode=255
Oct 30 06:56:31.628679 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.628644    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" event={"ID":"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9","Type":"ContainerDied","Data":"e30bd2e111003abec72cfaca0728b61700640a11373b9c604a8fe09c88b845da"}
Oct 30 06:56:31.629133 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.628882    2584 scope.go:122] "RemoveContainer" containerID="e30bd2e111003abec72cfaca0728b61700640a11373b9c604a8fe09c88b845da"
Oct 30 06:56:31.713193 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.712968    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-95gsq" podStartSLOduration=385.057589386 podStartE2EDuration="6m29.712953635s" totalImagesPullingTime="4.655364249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:31.710036419 +0000 UTC m=+36.946706319" watchObservedRunningTime="2026-10-30 06:56:31.712953635 +0000 UTC m=+36.949623532"
Oct 30 06:56:31.713193 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:31.713086    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh" podStartSLOduration=383.135450928 podStartE2EDuration="6m27.713082921s" totalImagesPullingTime="4.577631993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:31.664385343 +0000 UTC m=+36.901055237" watchObservedRunningTime="2026-10-30 06:56:31.713082921 +0000 UTC m=+36.949752818"
Oct 30 06:56:32.025370 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.025298    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w9vw6"]
Oct 30 06:56:32.047768 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.047713    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.055172 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.055140    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w9vw6"]
Oct 30 06:56:32.065085 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.065062    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 06:56:32.065220 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.065145    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 06:56:32.065278 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.065268    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5k2w\""
Oct 30 06:56:32.121130 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.121100    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-v9xr8-jmxsw"]
Oct 30 06:56:32.136975 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.136949    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.144296 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.144271    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-v9xr8-jmxsw"]
Oct 30 06:56:32.165083 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.165058    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4krqm\""
Oct 30 06:56:32.177161 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.177130    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"]
Oct 30 06:56:32.193934 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.193901    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"]
Oct 30 06:56:32.194051 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.194019    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:32.201956 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.201905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51d62594-4baa-4505-9f8a-ab165b3b1ba0-crio-socket\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.202072 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.201961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.202134 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.202070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d62594-4baa-4505-9f8a-ab165b3b1ba0-data-volume\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.202134 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.202105    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgsds\" (UniqueName: \"kubernetes.io/projected/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-api-access-sgsds\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.202226 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.202172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.209534 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.209513    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"]
Oct 30 06:56:32.209634 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.209623    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:32.212320 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.212275    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"]
Oct 30 06:56:32.214793 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.214769    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:32.214904 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.214799    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 06:56:32.264951 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.264920    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b8s8m\""
Oct 30 06:56:32.303450 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d62594-4baa-4505-9f8a-ab165b3b1ba0-data-volume\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.303450 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303410    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9rnd\" (UniqueName: \"kubernetes.io/projected/af38d809-602c-4cd6-a630-600a1400f605-kube-api-access-l9rnd\") pod \"migrator-66df5d496b-8wh56\" (UID: \"af38d809-602c-4cd6-a630-600a1400f605\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:32.303639 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303457    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgsds\" (UniqueName: \"kubernetes.io/projected/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-api-access-sgsds\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.303639 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.303639 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.303768 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303642    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.303768 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303689    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.303880 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51d62594-4baa-4505-9f8a-ab165b3b1ba0-crio-socket\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.303880 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303811    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.303880 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.303839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.304007 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.303954    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 06:56:32.304050 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.304012    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:32.803993209 +0000 UTC m=+38.040663090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : configmap "kube-rbac-proxy" not found
Oct 30 06:56:32.304695 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.304673    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d62594-4baa-4505-9f8a-ab165b3b1ba0-data-volume\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.304817 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.304800    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:32.304890 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.304868    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:32.804836896 +0000 UTC m=+38.041506785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:32.304973 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.304960    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51d62594-4baa-4505-9f8a-ab165b3b1ba0-crio-socket\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.332251 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.332227    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgsds\" (UniqueName: \"kubernetes.io/projected/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-api-access-sgsds\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.405032 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.405190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9rnd\" (UniqueName: \"kubernetes.io/projected/af38d809-602c-4cd6-a630-600a1400f605-kube-api-access-l9rnd\") pod \"migrator-66df5d496b-8wh56\" (UID: \"af38d809-602c-4cd6-a630-600a1400f605\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:32.405190 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmlgf\" (UniqueName: \"kubernetes.io/projected/609ce248-2b9f-4fc1-b23a-b075ca520a3e-kube-api-access-jmlgf\") pod \"migrator-66df5d496b-8tgr6\" (UID: \"609ce248-2b9f-4fc1-b23a-b075ca520a3e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:32.405272 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.405272 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405262    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.405336 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.405658 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.405635    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.406035 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.406013    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.406617 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.406598    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.432428 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.432374    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9rnd\" (UniqueName: \"kubernetes.io/projected/af38d809-602c-4cd6-a630-600a1400f605-kube-api-access-l9rnd\") pod \"migrator-66df5d496b-8wh56\" (UID: \"af38d809-602c-4cd6-a630-600a1400f605\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:32.433332 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.433312    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.463182 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.463158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:32.506409 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.506380    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlgf\" (UniqueName: \"kubernetes.io/projected/609ce248-2b9f-4fc1-b23a-b075ca520a3e-kube-api-access-jmlgf\") pod \"migrator-66df5d496b-8tgr6\" (UID: \"609ce248-2b9f-4fc1-b23a-b075ca520a3e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:32.522769 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.522742    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:32.532697 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.532667    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlgf\" (UniqueName: \"kubernetes.io/projected/609ce248-2b9f-4fc1-b23a-b075ca520a3e-kube-api-access-jmlgf\") pod \"migrator-66df5d496b-8tgr6\" (UID: \"609ce248-2b9f-4fc1-b23a-b075ca520a3e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:32.535408 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.535387    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:32.640024 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.639996    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/1.log"
Oct 30 06:56:32.640471 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.640451    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/0.log"
Oct 30 06:56:32.640547 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.640491    2584 generic.go:356] "Generic (PLEG): container finished" podID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef" exitCode=255
Oct 30 06:56:32.640603 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.640571    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" event={"ID":"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9","Type":"ContainerDied","Data":"9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef"}
Oct 30 06:56:32.640660 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.640623    2584 scope.go:122] "RemoveContainer" containerID="e30bd2e111003abec72cfaca0728b61700640a11373b9c604a8fe09c88b845da"
Oct 30 06:56:32.641671 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.641053    2584 scope.go:122] "RemoveContainer" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef"
Oct 30 06:56:32.641671 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.641281    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-m59nb_openshift-console-operator(7c4c7ef9-3135-44ee-afd2-f49226ff7ba9)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9"
Oct 30 06:56:32.648103 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.647409    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb" event={"ID":"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792","Type":"ContainerStarted","Data":"898ee2ee050b4b09da62e36d09d36c57e831c7f31138eb71e46d55334a7bb01d"}
Oct 30 06:56:32.653485 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.653026    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xghrm" event={"ID":"3a361442-634d-4ff5-990a-29095aa6264d","Type":"ContainerStarted","Data":"55b333305618c32f5d7032e0057f8577832c352670c898861e72e65a3fdd90e6"}
Oct 30 06:56:32.743887 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.738157    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xghrm" podStartSLOduration=1.8668325220000002 podStartE2EDuration="7.738140059s" totalImagesPullingTime="5.871307537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:32.738074367 +0000 UTC m=+37.974744284" watchObservedRunningTime="2026-10-30 06:56:32.738140059 +0000 UTC m=+37.974809957"
Oct 30 06:56:32.788279 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.787877    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb" podStartSLOduration=386.627198335 podStartE2EDuration="6m31.787839196s" totalImagesPullingTime="5.160640861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:32.784924537 +0000 UTC m=+38.021594460" watchObservedRunningTime="2026-10-30 06:56:32.787839196 +0000 UTC m=+38.024509094"
Oct 30 06:56:32.804910 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.804258    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-v9xr8-jmxsw"]
Oct 30 06:56:32.809866 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.809823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.810191 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.810170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:32.810869 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.810826    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 06:56:32.810960 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.810949    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.810927331 +0000 UTC m=+39.047597219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : configmap "kube-rbac-proxy" not found
Oct 30 06:56:32.811753 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.811734    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:32.811841 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:32.811805    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:33.811788082 +0000 UTC m=+39.048457974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:32.883338 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.883266    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"]
Oct 30 06:56:32.922591 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:32.922519    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"]
Oct 30 06:56:32.928907 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:32.928840    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609ce248_2b9f_4fc1_b23a_b075ca520a3e.slice/crio-06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2 WatchSource:0}: Error finding container 06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2: Status 404 returned error can't find the container with id 06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2
Oct 30 06:56:33.273839 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.272527    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-ft8fb"]
Oct 30 06:56:33.289567 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.289494    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.296697 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.296670    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-ft8fb"]
Oct 30 06:56:33.307373 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.307338    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9dbnh\""
Oct 30 06:56:33.307473 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.307413    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 06:56:33.341387 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.341259    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 06:56:33.341387 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.341359    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 06:56:33.341387 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.341368    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 06:56:33.417681 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.417323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-cabundle\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.417681 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.417406    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9xb\" (UniqueName: \"kubernetes.io/projected/e2d9f695-6bb2-433a-862a-3e626fedbe8e-kube-api-access-nz9xb\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.417681 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.417455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-key\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518126    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-cabundle\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518252    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9xb\" (UniqueName: \"kubernetes.io/projected/e2d9f695-6bb2-433a-862a-3e626fedbe8e-kube-api-access-nz9xb\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.519168 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.518361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-key\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.519669 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519392    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:33.519669 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519464    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls podName:df38da75-f716-4dd4-a6eb-f736d0d2ac6c nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.519442361 +0000 UTC m=+46.756112252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-88z7x" (UID: "df38da75-f716-4dd4-a6eb-f736d0d2ac6c") : secret "cluster-monitoring-operator-tls" not found
Oct 30 06:56:33.519886 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519868    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.519841062 +0000 UTC m=+46.756510942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : configmap references non-existent config key: service-ca.crt
Oct 30 06:56:33.520006 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519914    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 06:56:33.520006 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519950    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 06:56:33.520006 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519974    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert podName:acb49735-f2be-44e2-92f2-65f68a386864 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.519956738 +0000 UTC m=+46.756626626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-b7r65" (UID: "acb49735-f2be-44e2-92f2-65f68a386864") : secret "networking-console-plugin-cert" not found
Oct 30 06:56:33.520006 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.519992    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs podName:5d01ad1b-d546-48f6-b5b8-980de74eb623 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.519983386 +0000 UTC m=+46.756653263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs") pod "router-default-789654ff5-xkswj" (UID: "5d01ad1b-d546-48f6-b5b8-980de74eb623") : secret "router-metrics-certs-default" not found
Oct 30 06:56:33.520653 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.520453    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-cabundle\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.523597 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.523548    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-key\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.545609 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.545523    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9xb\" (UniqueName: \"kubernetes.io/projected/e2d9f695-6bb2-433a-862a-3e626fedbe8e-kube-api-access-nz9xb\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.618340 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.618111    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:33.619877 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.619825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:33.620004 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.619891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:33.620004 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.619958    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:33.620120 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.620008    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:33.620120 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.620029    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:33.620120 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.620016    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.619999527 +0000 UTC m=+46.856669422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:33.620120 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.620091    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.620073486 +0000 UTC m=+46.856743370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:33.660398 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.660307    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56" event={"ID":"af38d809-602c-4cd6-a630-600a1400f605","Type":"ContainerStarted","Data":"e9017647d7dd0a58552200b9f42ea77a1ef798e5249034ad268e3072ecd70237"}
Oct 30 06:56:33.663009 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.662987    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/1.log"
Oct 30 06:56:33.663440 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.663423    2584 scope.go:122] "RemoveContainer" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef"
Oct 30 06:56:33.663647 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.663626    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-m59nb_openshift-console-operator(7c4c7ef9-3135-44ee-afd2-f49226ff7ba9)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9"
Oct 30 06:56:33.667068 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.666587    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7" event={"ID":"95661150-16a9-4b3a-9660-9ad8feaa09a9","Type":"ContainerStarted","Data":"dc63e25cbd458c39b10fe5eeb02fe20ed5015b3c1a73aad1f05f635372ab9f32"}
Oct 30 06:56:33.673387 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.673329    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6" event={"ID":"609ce248-2b9f-4fc1-b23a-b075ca520a3e","Type":"ContainerStarted","Data":"06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2"}
Oct 30 06:56:33.675585 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.675564    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw" event={"ID":"b3327489-8c96-4b81-b440-fd58d4d2fd0b","Type":"ContainerStarted","Data":"8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b"}
Oct 30 06:56:33.675688 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.675602    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw" event={"ID":"b3327489-8c96-4b81-b440-fd58d4d2fd0b","Type":"ContainerStarted","Data":"a3e1b62f14c923614bb07faa2f475a60e8e2f3f83a6a3f415ad76de17c3871b9"}
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.720925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.720977    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.721114    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.721130    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.721185    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.72116812 +0000 UTC m=+46.957838012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.721605    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 06:56:33.722251 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.721661    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls podName:e34614b0-e9e0-48fa-ae70-99404431cc66 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:41.721645759 +0000 UTC m=+46.958315648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4gvn9" (UID: "e34614b0-e9e0-48fa-ae70-99404431cc66") : secret "samples-operator-tls" not found
Oct 30 06:56:33.773899 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.773827    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw" podStartSLOduration=1.773807331 podStartE2EDuration="1.773807331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:33.770539633 +0000 UTC m=+39.007209532" watchObservedRunningTime="2026-10-30 06:56:33.773807331 +0000 UTC m=+39.010477230"
Oct 30 06:56:33.814282 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.813822    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7" podStartSLOduration=371.102229461 podStartE2EDuration="6m17.813810925s" totalImagesPullingTime="6.711581464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:33.812436815 +0000 UTC m=+39.049106733" watchObservedRunningTime="2026-10-30 06:56:33.813810925 +0000 UTC m=+39.050480821"
Oct 30 06:56:33.822449 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.822422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:33.822693 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.822676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:33.822812 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.822798    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:33.822886 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.822844    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:35.822832603 +0000 UTC m=+41.059502479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:33.823175 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.823144    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 06:56:33.823229 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:33.823208    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:35.823191009 +0000 UTC m=+41.059860901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : configmap "kube-rbac-proxy" not found
Oct 30 06:56:33.978290 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:33.978252    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-ft8fb"]
Oct 30 06:56:33.991142 ip-10-0-132-33 kubenswrapper[2584]: W1030 06:56:33.991110    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d9f695_6bb2_433a_862a_3e626fedbe8e.slice/crio-9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b WatchSource:0}: Error finding container 9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b: Status 404 returned error can't find the container with id 9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b
Oct 30 06:56:34.685877 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:34.685817    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb" event={"ID":"e2d9f695-6bb2-433a-862a-3e626fedbe8e","Type":"ContainerStarted","Data":"52a13849f92cd1fe908e5bc2b245498554f5840908c59a51d5ab6910e0d7057a"}
Oct 30 06:56:34.686279 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:34.685928    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb" event={"ID":"e2d9f695-6bb2-433a-862a-3e626fedbe8e","Type":"ContainerStarted","Data":"9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b"}
Oct 30 06:56:34.729423 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:34.729373    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb" podStartSLOduration=1.729360567 podStartE2EDuration="1.729360567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:34.727974292 +0000 UTC m=+39.964644188" watchObservedRunningTime="2026-10-30 06:56:34.729360567 +0000 UTC m=+39.966030522"
Oct 30 06:56:35.333443 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.333418    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kg9qk_334689c1-93d2-4b74-8d46-20890f606782/dns-node-resolver/0.log"
Oct 30 06:56:35.691945 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.691838    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56" event={"ID":"af38d809-602c-4cd6-a630-600a1400f605","Type":"ContainerStarted","Data":"d5c84dbe1fc5ffed224a57bb8e7bdebb748846675336a17bdd84b17486d30733"}
Oct 30 06:56:35.693763 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.693735    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6" event={"ID":"609ce248-2b9f-4fc1-b23a-b075ca520a3e","Type":"ContainerStarted","Data":"1a6ec038ea160f350735d5a9d8d22e996acc6726d3a6eedd820b82bca4ab584a"}
Oct 30 06:56:35.695357 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.695332    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jlk9l" event={"ID":"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b","Type":"ContainerStarted","Data":"0ca825e76cbb9ec74a74dbc2de6abbee4f38fb2189a789fcacbc2341846bfd96"}
Oct 30 06:56:35.741701 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.741647    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56" podStartSLOduration=1.841699331 podStartE2EDuration="3.741630842s" totalImagesPullingTime="1.899931511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:35.7403548 +0000 UTC m=+40.977024697" watchObservedRunningTime="2026-10-30 06:56:35.741630842 +0000 UTC m=+40.978300740"
Oct 30 06:56:35.785014 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.784949    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jlk9l" podStartSLOduration=34.377711033 podStartE2EDuration="39.784931069s" totalImagesPullingTime="5.407220036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:35.783110169 +0000 UTC m=+41.019780079" watchObservedRunningTime="2026-10-30 06:56:35.784931069 +0000 UTC m=+41.021600971"
Oct 30 06:56:35.826544 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.826486    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6" podStartSLOduration=1.814798192 podStartE2EDuration="3.826468457s" totalImagesPullingTime="2.011670265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:35.824755601 +0000 UTC m=+41.061425500" watchObservedRunningTime="2026-10-30 06:56:35.826468457 +0000 UTC m=+41.063138355"
Oct 30 06:56:35.842278 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.842244    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:35.842429 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:35.842378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:35.842429 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:35.842390    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:35.842518 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:35.842461    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.842442726 +0000 UTC m=+45.079112616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:35.842518 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:35.842504    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 06:56:35.842632 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:35.842580    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.842566029 +0000 UTC m=+45.079235919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : configmap "kube-rbac-proxy" not found
Oct 30 06:56:36.132408 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:36.132321    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fnh8d_dae48309-e15e-4919-a6d3-051758b7a23e/node-ca/0.log"
Oct 30 06:56:36.159902 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:36.159848    2584 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:36.160048 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:36.159934    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:36.160358 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:36.160338    2584 scope.go:122] "RemoveContainer" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef"
Oct 30 06:56:36.160585 ip-10-0-132-33 kubenswrapper[2584]: E1030 06:56:36.160561    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-m59nb_openshift-console-operator(7c4c7ef9-3135-44ee-afd2-f49226ff7ba9)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9"
Oct 30 06:56:36.699306 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:36.699275    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:36.932201 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:36.932173    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xghrm_3a361442-634d-4ff5-990a-29095aa6264d/serve-healthcheck-canary/0.log"
Oct 30 06:56:37.133786 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:37.133757    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-8tgr6_609ce248-2b9f-4fc1-b23a-b075ca520a3e/migrator/0.log"
Oct 30 06:56:37.234484 ip-10-0-132-33 kubenswrapper[2584]: I1030 06:56:37.234319    2584 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 06:56:37.234479 ip-10-0-132-33 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 06:56:37.250254 ip-10-0-132-33 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 06:56:37.250424 ip-10-0-132-33 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 06:56:37.250470 ip-10-0-132-33 systemd[1]: kubelet.service: Consumed 3.191s CPU time.
Oct 30 06:56:37.261396 ip-10-0-132-33 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 06:56:37.337290 ip-10-0-132-33 kubenswrapper[5073]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 06:56:37.337290 ip-10-0-132-33 kubenswrapper[5073]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 06:56:37.337290 ip-10-0-132-33 kubenswrapper[5073]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 06:56:37.337290 ip-10-0-132-33 kubenswrapper[5073]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 06:56:37.339352 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339271    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.339352 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339351    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.339352 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339355    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339359    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339362    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339364    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339368    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339371    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339373    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339376    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339379    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339382    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339386    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339390    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339401    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339407    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339410    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339413    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339415    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339418    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339421    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.339498 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339423    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339426    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339429    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339431    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339434    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339437    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339440    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339443    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339445    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339448    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339450    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339453    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339456    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339459    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339462    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339464    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339467    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339470    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339473    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.340014 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339475    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339478    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339480    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339483    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339486    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339489    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339491    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339497    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339500    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339503    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339506    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339508    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339511    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339514    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339516    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339520    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339523    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339525    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339528    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.340519 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339531    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339533    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339537    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339539    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339542    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339545    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339566    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339570    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339574    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339577    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339580    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339583    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339585    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339588    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339591    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339594    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339597    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339599    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339602    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339605    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.341015 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339609    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339612    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339615    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339617    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339620    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339623    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339625    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339628    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339631    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339633    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339636    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339640    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339644    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339647    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339650    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339653    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339656    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339659    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339661    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.341517 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339664    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339666    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339669    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339671    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339674    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339677    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339680    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.339683    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340439    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340446    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340449    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340452    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340455    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340460    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340463    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340466    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340469    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340472    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340474    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340477    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.342039 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340480    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340483    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340485    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340488    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340491    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340493    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340496    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340498    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340501    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340504    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340508    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340512    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340515    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340517    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340520    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340523    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340525    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340528    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340531    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.342531 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340534    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340536    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340541    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340543    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340546    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340548    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340552    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340554    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340557    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340560    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340563    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340565    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340568    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340570    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340573    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340577    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340581    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340584    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340586    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340589    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.343048 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340592    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340595    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340597    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340600    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340602    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340605    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340608    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340610    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340613    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340615    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340618    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340620    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340623    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340625    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340629    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340632    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340634    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340637    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340640    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.343567 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340643    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340645    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340648    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340651    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340653    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340656    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340659    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340661    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340664    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340666    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340669    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340672    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340674    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340677    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340679    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340682    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340684    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340687    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340689    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340692    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.344086 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340694    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340697    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340699    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340702    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340704    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340707    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340709    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340713    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340716    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340719    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340722    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340724    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340727    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340730    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340732    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.340735    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341243    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341249    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341252    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341255    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.344626 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341258    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341260    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341263    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341266    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341269    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341273    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341275    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341278    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341280    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341283    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341286    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341288    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341291    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341293    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341296    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341299    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341301    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341304    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341306    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341311    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.345220 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341314    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341316    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341319    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341321    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341325    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341328    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341330    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341333    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341336    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341339    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341342    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341344    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341347    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341349    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341352    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341354    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341357    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341360    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341362    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.345711 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341365    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341367    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341370    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341372    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341375    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341378    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341380    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341383    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341385    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341388    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341390    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341393    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341397    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341399    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341402    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341405    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341407    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341412    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341415    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.346197 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341417    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341420    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341422    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341425    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341429    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341432    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341435    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341438    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341440    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341443    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341445    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341448    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341451    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341453    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341456    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341458    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341461    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341464    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341466    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341469    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.346665 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341471    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341474    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341476    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341479    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341482    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341486    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341488    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341491    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341493    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341496    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341500    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341502    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341505    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341507    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341510    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341513    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341516    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341518    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341523    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.347168 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341527    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341530    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341533    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341536    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.341538    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341624    5073 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341631    5073 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341638    5073 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341642    5073 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341649    5073 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341652    5073 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341665    5073 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341671    5073 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341678    5073 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341683    5073 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341686    5073 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341690    5073 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341693    5073 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341697    5073 flags.go:64] FLAG: --cgroup-root=""
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341700    5073 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341703    5073 flags.go:64] FLAG: --client-ca-file=""
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341706    5073 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341709    5073 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341714    5073 flags.go:64] FLAG: --cluster-domain=""
Oct 30 06:56:37.347627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341717    5073 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341720    5073 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341723    5073 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341727    5073 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341731    5073 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341734    5073 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341737    5073 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341741    5073 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341744    5073 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341747    5073 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341750    5073 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341754    5073 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341757    5073 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341761    5073 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341764    5073 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341767    5073 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341770    5073 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341773    5073 flags.go:64] FLAG: --enable-server="true"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341776    5073 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341780    5073 flags.go:64] FLAG: --event-burst="100"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341784    5073 flags.go:64] FLAG: --event-qps="50"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341787    5073 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341790    5073 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341793    5073 flags.go:64] FLAG: --eviction-hard=""
Oct 30 06:56:37.348262 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341797    5073 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341800    5073 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341803    5073 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341807    5073 flags.go:64] FLAG: --eviction-soft=""
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341810    5073 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341813    5073 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341816    5073 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341821    5073 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341824    5073 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341827    5073 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341829    5073 flags.go:64] FLAG: --feature-gates=""
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341834    5073 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341837    5073 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341840    5073 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341844    5073 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341847    5073 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341863    5073 flags.go:64] FLAG: --help="false"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341867    5073 flags.go:64] FLAG: --hostname-override="ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341870    5073 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341873    5073 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341876    5073 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341879    5073 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341883    5073 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341886    5073 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 06:56:37.348879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341889    5073 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341892    5073 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341895    5073 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341898    5073 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341902    5073 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341905    5073 flags.go:64] FLAG: --kube-reserved=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341908    5073 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341911    5073 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341914    5073 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341917    5073 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341920    5073 flags.go:64] FLAG: --lock-file=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341923    5073 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341926    5073 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341929    5073 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341934    5073 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341941    5073 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341944    5073 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341946    5073 flags.go:64] FLAG: --logging-format="text"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341950    5073 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341953    5073 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341956    5073 flags.go:64] FLAG: --manifest-url=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341959    5073 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341964    5073 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341967    5073 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341971    5073 flags.go:64] FLAG: --max-pods="110"
Oct 30 06:56:37.349504 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341975    5073 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341978    5073 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341981    5073 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341984    5073 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341987    5073 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341990    5073 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341993    5073 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.341999    5073 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342002    5073 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342006    5073 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342009    5073 flags.go:64] FLAG: --pod-cidr=""
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342012    5073 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342015    5073 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342018    5073 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342021    5073 flags.go:64] FLAG: --port="10250"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342024    5073 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342027    5073 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-091f32acca7f7fdfd"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342030    5073 flags.go:64] FLAG: --qos-reserved=""
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342033    5073 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342037    5073 flags.go:64] FLAG: --register-node="true"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342040    5073 flags.go:64] FLAG: --register-with-taints=""
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342044    5073 flags.go:64] FLAG: --registry-burst="10"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342048    5073 flags.go:64] FLAG: --registry-qps="5"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342051    5073 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342055    5073 flags.go:64] FLAG: --reserved-memory=""
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342059    5073 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 06:56:37.350147 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342062    5073 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342065    5073 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342068    5073 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342071    5073 flags.go:64] FLAG: --runonce="false"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342074    5073 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342077    5073 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342081    5073 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342084    5073 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342087    5073 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342090    5073 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342093    5073 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342098    5073 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342101    5073 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342104    5073 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342107    5073 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342110    5073 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342113    5073 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342116    5073 flags.go:64] FLAG: --system-cgroups=""
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342119    5073 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342124    5073 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342127    5073 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342130    5073 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342134    5073 flags.go:64] FLAG: --tls-min-version=""
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342136    5073 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342139    5073 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 06:56:37.350782 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342142    5073 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342145    5073 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342148    5073 flags.go:64] FLAG: --v="2"
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342153    5073 flags.go:64] FLAG: --version="false"
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342157    5073 flags.go:64] FLAG: --vmodule=""
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342161    5073 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342165    5073 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342297    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342301    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342304    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342306    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342309    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342312    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342315    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342318    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342321    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342323    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342326    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342330    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342333    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342336    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.351392 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342339    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342342    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342344    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342347    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342350    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342353    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342355    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342359    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342363    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342366    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342369    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342372    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342374    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342377    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342381    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342384    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342387    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342389    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342392    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.351933 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342395    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342397    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342400    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342403    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342406    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342408    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342411    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342414    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342417    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342420    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342424    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342426    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342429    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342432    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342435    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342437    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342440    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342443    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342445    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.352412 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342449    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342453    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342456    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342459    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342462    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342465    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342467    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342470    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342475    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342477    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342480    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342483    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342486    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342488    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342491    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342494    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342497    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342500    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342502    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.353025 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342505    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342508    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342511    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342513    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342518    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342520    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342523    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342525    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342528    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342531    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342534    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342537    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342539    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342542    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342545    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342547    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342550    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342552    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342555    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342558    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.353767 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342560    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342564    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342567    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342570    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342573    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342575    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342578    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342581    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342584    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342586    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342589    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342592    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342594    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342597    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342599    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.342624    5073 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 06:56:37.354478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342658    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342662    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342666    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342669    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342671    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342674    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342676    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342679    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342683    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342687    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342691    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342694    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342697    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342700    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342702    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342706    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342708    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342711    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342715    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.355058 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342717    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342720    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342722    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342725    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342728    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342730    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342733    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342736    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342738    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342741    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342744    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342746    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342749    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342754    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342756    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342759    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342762    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342764    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342767    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.355604 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342769    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342772    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342774    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342777    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342780    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342782    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342785    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342787    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342790    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342793    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342795    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342798    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342802    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342804    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342807    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342810    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342812    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342815    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342817    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342820    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.356215 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342823    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342825    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342828    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342830    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342833    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342836    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342865    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342873    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342878    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342882    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342887    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342890    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342892    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342895    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342897    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342900    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342903    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342906    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342908    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342911    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.357095 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342913    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342916    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342919    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342921    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342925    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342930    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342934    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342937    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342940    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342943    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342946    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342949    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342951    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342954    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342957    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342959    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342962    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342965    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342968    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.357938 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342971    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342974    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342978    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342981    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342983    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342986    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342989    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342991    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.342994    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.347441    5073 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.347460    5073 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.347483    5073 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.347490    5073 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347570    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347576    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347581    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347585    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347590    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347594    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.358512 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347598    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347603    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347607    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347612    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347616    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347620    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347625    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347629    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347636    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347642    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347647    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347651    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347656    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347661    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347666    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347670    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347674    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347679    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347684    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.359122 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347688    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347692    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347696    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347701    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347706    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347710    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347715    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347719    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347723    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347727    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347731    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347736    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347740    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347745    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347749    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347753    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347757    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347761    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347766    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347770    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.359591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347774    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347778    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347782    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347786    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347791    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347795    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347799    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347804    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347808    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347812    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347816    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347820    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347824    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347828    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347833    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347837    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347842    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347866    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347871    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.360098 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347875    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347879    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347883    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347887    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347892    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347896    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347900    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347904    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347908    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347912    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347916    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347921    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347927    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347932    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347937    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347941    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347945    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347949    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347954    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347958    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.360576 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347962    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347966    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347971    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347975    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347979    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347983    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347987    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347992    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.347996    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348000    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348004    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348009    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348013    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348017    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348021    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348026    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348030    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348034    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348038    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.361067 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348042    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348046    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348050    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.348088    5073 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348291    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348297    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348301    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348305    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348310    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348314    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348319    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348323    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348327    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348331    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348335    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348339    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.361521 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348344    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348348    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348352    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348356    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348360    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348371    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348376    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348380    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348385    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348390    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348394    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348399    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348402    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348407    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348411    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348416    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348420    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348424    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348428    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348432    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.361989 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348436    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348440    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348445    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348449    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348454    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348458    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348462    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348467    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348471    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348475    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348480    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348484    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348489    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348493    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348497    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348502    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348506    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348510    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348515    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.362545 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348519    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348523    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348528    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348533    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348537    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348541    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348546    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348550    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348554    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348558    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348562    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348569    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348575    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348580    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348586    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348591    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348596    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348600    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348604    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.363239 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348609    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348613    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348617    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348621    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348625    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348629    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348633    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348637    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348641    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348645    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348649    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348653    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348657    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348661    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348665    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348670    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348674    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348682    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348687    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.363740 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348691    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348695    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348701    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348706    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348711    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348715    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348719    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348723    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348727    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348732    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348736    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348740    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348744    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348748    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348752    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348756    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.364253 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348760    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.348794    5073 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348845    5073 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348865    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348870    5073 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348874    5073 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348878    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348883    5073 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348887    5073 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348891    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348895    5073 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348902    5073 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348906    5073 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348910    5073 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348916    5073 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348921    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 06:56:37.364716 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348925    5073 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348930    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348934    5073 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348938    5073 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348942    5073 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348947    5073 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348951    5073 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348955    5073 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348959    5073 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348963    5073 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348967    5073 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348971    5073 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348975    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348981    5073 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348988    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348993    5073 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.348998    5073 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349003    5073 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349008    5073 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 06:56:37.365138 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349012    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349016    5073 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349021    5073 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349025    5073 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349029    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349033    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349037    5073 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349041    5073 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349047    5073 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349051    5073 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349055    5073 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349061    5073 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349066    5073 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349070    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349074    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349079    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349083    5073 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349087    5073 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349092    5073 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349096    5073 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 06:56:37.365591 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349100    5073 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349104    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349108    5073 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349112    5073 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349116    5073 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349121    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349125    5073 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349129    5073 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349133    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349138    5073 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349143    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349147    5073 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349152    5073 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349156    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349160    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349165    5073 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349169    5073 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349173    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349177    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349181    5073 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 06:56:37.366137 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349187    5073 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349191    5073 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349195    5073 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349201    5073 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349205    5073 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349209    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349214    5073 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349218    5073 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349222    5073 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349226    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349231    5073 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349235    5073 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349239    5073 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349243    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349247    5073 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349251    5073 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349255    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349260    5073 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349264    5073 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 06:56:37.366651 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349267    5073 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349271    5073 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349276    5073 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349280    5073 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349284    5073 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349288    5073 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349292    5073 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349296    5073 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349300    5073 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349304    5073 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349309    5073 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349313    5073 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349320    5073 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:37.349328    5073 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.349395    5073 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.350827    5073 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.350905    5073 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.351150    5073 server.go:1014] "Starting client certificate rotation"
Oct 30 06:56:37.367342 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.351278    5073 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.351330    5073 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 06:50:55 +0000 UTC" deadline="2028-03-26 15:45:47.519476344 +0000 UTC"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.351357    5073 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12320h49m10.168121142s"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.351788    5073 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.354095    5073 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.355780    5073 log.go:25] "Validated CRI v1 runtime API"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.357937    5073 log.go:25] "Validated CRI v1 image API"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.358669    5073 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 06:56:37.367978 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.360721    5073 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8d1b9418-125d-46cc-8725-2fae71405a51:/dev/nvme0n1p3 a8f84757-d3d2-4182-aab0-b0e9f32f150b:/dev/nvme0n1p4]
Oct 30 06:56:37.368319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.360739    5073 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2/userdata/shm major:0 minor:325 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/084aaf720ff93c80ccbb8d0d60f7183a68339cc4a93d286b7ee202bfb8eed100/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/084aaf720ff93c80ccbb8d0d60f7183a68339cc4a93d286b7ee202bfb8eed100/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74ef3d75fdf13ac9767d6238c8133ad861d58cce320b3d680618b4b838d6260e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74ef3d75fdf13ac9767d6238c8133ad861d58cce320b3d680618b4b838d6260e/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b/userdata/shm major:0 minor:356 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a3e1b62f14c923614bb07faa2f475a60e8e2f3f83a6a3f415ad76de17c3871b9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a3e1b62f14c923614bb07faa2f475a60e8e2f3f83a6a3f415ad76de17c3871b9/userdata/shm major:0 minor:326 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a890cebd9d21e4b967ab90b3577c7e7c4da438e598e8fc1ce39e1e889255df07/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a890cebd9d21e4b967ab90b3577c7e7c4da438e598e8fc1ce39e1e889255df07/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802/userdata/shm major:0 minor:221 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/baaa9ce67de7d65c84bb3cdcb409d613fe548e1cac5ed074133fa41c5a16f91e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/baaa9ce67de7d65c84bb3cdcb409d613fe548e1cac5ed074133fa41c5a16f91e/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c30516b149097c8d0ef03d7d7af0de911603a8df11dca8a5e113b948741b4689/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c30516b149097c8d0ef03d7d7af0de911603a8df11dca8a5e113b948741b4689/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e9017647d7dd0a58552200b9f42ea77a1ef798e5249034ad268e3072ecd70237/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e9017647d7dd0a58552200b9f42ea77a1ef798e5249034ad268e3072ecd70237/userdata/shm major:0 minor:333 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f43f97049c89140b34b8b3b6b26b95e2d26af56a5fa2ad31b9ad36a86c87ac2b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f43f97049c89140b34b8b3b6b26b95e2d26af56a5fa2ad31b9ad36a86c87ac2b/userdata/shm major:0 minor:293 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04664ebb-d94a-4bfe-a346-b441a7da0e3f/volumes/kubernetes.io~projected/kube-api-access-n2pv7:{mountpoint:/var/lib/kubelet/pods/04664ebb-d94a-4bfe-a346-b441a7da0e3f/volumes/kubernetes.io~projected/kube-api-access-n2pv7 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/099c00ac-0c53-4bd5-be8f-de38e33f705e/volumes/kubernetes.io~projected/kube-api-access-5v2dp:{mountpoint:/var/lib/kubelet/pods/099c00ac-0c53-4bd5-be8f-de38e33f705e/volumes/kubernetes.io~projected/kube-api-access-5v2dp major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10492054-f044-4bee-93c4-e316fc500bff/volumes/kubernetes.io~projected/kube-api-access-zhntt:{mountpoint:/var/lib/kubelet/pods/10492054-f044-4bee-93c4-e316fc500bff/volumes/kubernetes.io~projected/kube-api-access-zhntt major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/334689c1-93d2-4b74-8d46-20890f606782/volumes/kubernetes.io~projected/kube-api-access-47gx5:{mountpoint:/var/lib/kubelet/pods/334689c1-93d2-4b74-8d46-20890f606782/volumes/kubernetes.io~projected/kube-api-access-47gx5 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a361442-634d-4ff5-990a-29095aa6264d/volumes/kubernetes.io~projected/kube-api-access-chrf4:{mountpoint:/var/lib/kubelet/pods/3a361442-634d-4ff5-990a-29095aa6264d/volumes/kubernetes.io~projected/kube-api-access-chrf4 major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a361442-634d-4ff5-990a-29095aa6264d/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/3a361442-634d-4ff5-990a-29095aa6264d/volumes/kubernetes.io~secret/cert major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46375128-278b-46e4-ace2-13374ad65d23/volumes/kubernetes.io~projected/kube-api-access-2kbp6:{mountpoint:/var/lib/kubelet/pods/46375128-278b-46e4-ace2-13374ad65d23/volumes/kubernetes.io~projected/kube-api-access-2kbp6 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/497c3d29-4ad7-4314-b73a-8015ea05057f/volumes/kubernetes.io~projected/kube-api-access-mx76m:{mountpoint:/var/lib/kubelet/pods/497c3d29-4ad7-4314-b73a-8015ea05057f/volumes/kubernetes.io~projected/kube-api-access-mx76m major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51d62594-4baa-4505-9f8a-ab165b3b1ba0/volumes/kubernetes.io~projected/kube-api-access-sgsds:{mountpoint:/var/lib/kubelet/pods/51d62594-4baa-4505-9f8a-ab165b3b1ba0/volumes/kubernetes.io~projected/kube-api-access-sgsds major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/580c167c-2e1f-4dbd-86b2-4412e856f1c2/volumes/kubernetes.io~projected/kube-api-access-h2lml:{mountpoint:/var/lib/kubelet/pods/580c167c-2e1f-4dbd-86b2-4412e856f1c2/volumes/kubernetes.io~projected/kube-api-access-h2lml major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~projected/kube-api-access-lrfg2:{mountpoint:/var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~projected/kube-api-access-lrfg2 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~secret/default-certificate major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~secret/stats-auth major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/609ce248-2b9f-4fc1-b23a-b075ca520a3e/volumes/kubernetes.io~projected/kube-api-access-jmlgf:{mountpoint:/var/lib/kubelet/pods/609ce248-2b9f-4fc1-b23a-b075ca520a3e/volumes/kubernetes.io~projected/kube-api-access-jmlgf major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~projected/kube-api-access-x6tvh:{mountpoint:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~projected/kube-api-access-x6tvh major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/volumes/kubernetes.io~projected/kube-api-access-h8vf7:{mountpoint:/var/lib/kubelet/pods/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/volumes/kubernetes.io~projected/kube-api-access-h8vf7 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/volumes/kubernetes.io~secret/serving-cert major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88abcbca-0455-472c-ab5a-6bd2a50d4544/volumes/kubernetes.io~projected/kube-api-access-kz9px:{mountpoint:/var/lib/kubelet/pods/88abcbca-0455-472c-ab5a-6bd2a50d4544/volumes/kubernetes.io~projected/kube-api-access-kz9px major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88abcbca-0455-472c-ab5a-6bd2a50d4544/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/88abcbca-0455-472c-ab5a-6bd2a50d4544/volumes/kubernetes.io~secret/serving-cert major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8d16b2df-cd08-4dd3-a1b3-88274a827068/volumes/kubernetes.io~projected/kube-api-access-mts4p:{mountpoint:/var/lib/kubelet/pods/8d16b2df-cd08-4dd3-a1b3-88274a827068/volumes/kubernetes.io~projected/kube-api-access-mts4p major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/95661150-16a9-4b3a-9660-9ad8feaa09a9/volumes/kubernetes.io~projected/kube-api-access-f6cwg:{mountpoint:/var/lib/kubelet/pods/95661150-16a9-4b3a-9660-9ad8feaa09a9/volumes/kubernetes.io~projected/kube-api-access-f6cwg major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96156c02-8e1f-4612-b919-b20007fe0dda/volumes/kubernetes.io~projected/kube-api-access-chsqg:{mountpoint:/var/lib/kubelet/pods/96156c02-8e1f-4612-b919-b20007fe0dda/volumes/kubernetes.io~projected/kube-api-access-chsqg major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96156c02-8e1f-4612-b919-b20007fe0dda/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/96156c02-8e1f-4612-b919-b20007fe0dda/volumes/kubernetes.io~secret/serving-cert major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e54b74c-ba81-405b-9002-c7ff8719e93d/volumes/kubernetes.io~projected/kube-api-access-dqk66:{mountpoint:/var/lib/kubelet/pods/9e54b74c-ba81-405b-9002-c7ff8719e93d/volumes/kubernetes.io~projected/kube-api-access-dqk66 major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a45a4f45-8253-4317-82ca-9edf34f33dbd/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/a45a4f45-8253-4317-82ca-9edf34f33dbd/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~projected/kube-api-access-5nnws:{mountpoint:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~projected/kube-api-access-5nnws major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a733e34a-1603-4bd5-8ef0-5ff872027fa6/volumes/kubernetes.io~projected/kube-api-access-r9vdm:{mountpoint:/var/lib/kubelet/pods/a733e34a-1603-4bd5-8ef0-5ff872027fa6/volumes/kubernetes.io~projected/kube-api-access-r9vdm major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af38d809-602c-4cd6-a630-600a1400f605/volumes/kubernetes.io~projected/kube-api-access-l9rnd:{mountpoint:/var/lib/kubelet/pods/af38d809-602c-4cd6-a630-600a1400f605/volumes/kubernetes.io~projected/kube-api-access-l9rnd major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b23a23e6-395f-4501-aab1-be26e3ff2236/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/b23a23e6-395f-4501-aab1-be26e3ff2236/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3327489-8c96-4b81-b440-fd58d4d2fd0b/volumes/kubernetes.io~projected/kube-api-access-xjqmx:{mountpoint:/var/lib/kubelet/pods/b3327489-8c96-4b81-b440-fd58d4d2fd0b/volumes/kubernetes.io~projected/kube-api-access-xjqmx major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b/volumes/kubernetes.io~projected/kube-api-access-ps8pz:{mountpoint:/var/lib/kubelet/pods/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b/volumes/kubernetes.io~projected/kube-api-access-ps8pz major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dae48309-e15e-4919-a6d3-051758b7a23e/volumes/kubernetes.io~projected/kube-api-access-tgp67:{mountpoint:/var/lib/kubelet/pods/dae48309-e15e-4919-a6d3-051758b7a23e/volumes/kubernetes.io~projected/kube-api-access-tgp67 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df38da75-f716-4dd4-a6eb-f736d0d2ac6c/volumes/kubernetes.io~projected/kube-api-access-xc6w6:{mountpoint:/var/lib/kubelet/pods/df38da75-f716-4dd4-a6eb-f736d0d2ac6c/volumes/kubernetes.io~projected/kube-api-access-xc6w6 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2d9f695-6bb2-433a-862a-3e626fedbe8e/volumes/kubernetes.io~projected/kube-api-access-nz9xb:{mountpoint:/var/lib/kubelet/pods/e2d9f695-6bb2-433a-862a-3e626fedbe8e/volumes/kubernetes.io~projected/kube-api-access-nz9xb major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2d9f695-6bb2-433a-862a-3e626fedbe8e/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/e2d9f695-6bb2-433a-862a-3e626fedbe8e/volumes/kubernetes.io~secret/signing-key major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e34614b0-e9e0-48fa-ae70-99404431cc66/volumes/kubernetes.io~projected/kube-api-access-z5g9l:{mountpoint:/var/lib/kubelet/pods/e34614b0-e9e0-48fa-ae70-99404431cc66/volumes/kubernetes.io~projected/kube-api-access-z5g9l major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volumes/kubernetes.io~projected/kube-api-access-pvfcl:{mountpoint:/var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volumes/kubernetes.io~projected/kube-api-access-pvfcl major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792/volumes/kubernetes.io~projected/kube-api-access-s5255:{mountpoint:/var/lib/kubelet/pods/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792/volumes/kubernetes.io~projected/kube-api-access-s5255 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792/volumes/kubernetes.io~secret/serving-cert major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~projected/kube-api-access-jd9pc:{mountpoint:/var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~projected/kube-api-access-jd9pc major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4/volumes/kubernetes.io~projected/kube-api-access-b6r4j:{mountpoint:/var/lib/kubelet/pods/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4/volumes/kubernetes.io~projected/kube-api-access-b6r4j major:0 minor:59 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/841931cd625e6faa073e0c549ea8385928bf65fb3c10330e810ab34727f035c9/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/4de34559fb9d272abe7e28401b9ac81463ac10dc92ba7834cc8c4b89d31d3584/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/71949d2625f6bfc9dd85bac6c76b4e29aa6f2c5a7c55052955bfc276027062ba/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/7c413f2b67feb89487e92f323e7f82c35ef568a02f04bd31f804905756a5ea5e/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/85ab4b0c779043fadd3b3020279bddba87ea14d931d2532ea76c96cd23d009ce/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/b9a629f909739945e2b2c5e62a60c1a18ca75dd0533c4752dd09c94632f01419/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/ee5fda45b58c93ad1b59317d47230441cc816e4db0744c824f284d5a7b183195/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/1c196659777945ce9b5942d796e714722c21acd81ea273a62cfcf73f06219961/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/d2a40a5f916ffd987eb19e8df7589c1a4bb0ffd75c535ba83e1976803d961370/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/959cda817ba39ab2f3111c927574e087e7a736431dfffb87bddcc100f290edf5/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/0ba8186569567ebb83455aaecd60a27fb6fd15344ebd85ceb5ba7dde2c622b5d/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/ef3b6660fcfb77a3cc177f31721561111a8cef5e8e4fae718cebcb6c6fb56e49/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/afcd247d13edeb9960c22284d10f99a9e6f644eb3854da8d910c7a998d3f4ec2/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/8bc01600d798fceb41a5dca85193f98bda827c289d2fae8f2596dfa3783c0f61/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/84721b48c0641dd2fc80662f457260ef60aba9d87d986c06b5161e71478e6779/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/0bff32a1634e7a59c77525736a7fdc53f27597b0f0cdb57302f5bc006911fc3b/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/3bed02572da70a18ce4195b1adc74fc38acd2c003d923f5917e13e70d7a2511f/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/3249ed9b979f160d6868aa82e9db2d4a66b1d03433a2334747a420043ec3c1b3/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/3a9eb9f43aae5744d22bc2baddce2484bf51a5e2bb119e3ba537d8a9a912e30d/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-184:{mountpoint:/var/lib/containers/storage/overlay/931e6d970345b95105c727bb6697e3910759a7ac5bf11c8c8a060ba2d6367b9d/merged major:0 minor:184 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/35fd51e5fcae9542c59b4a49b766c36699757cb4ac8fb2ad418be49f6340a65e/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/73cc3e828762169ce5cbffe30f91847a77c4b6399115eaaf6480642d52882b25/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/39d016301542b42c3f9e33aed3a616371b57f9815d596955e4027a7893d56099/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/5723bc7323ec20c9d3f909eab3e6cd839b2d2c925855db94f8db914adba03ee8/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/cfaad4ea9cd4f05b63811de9db4d802159085d98f887da789d1b754fcd7e5228/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/8960943163bcf94f5dc6c0f3f41bbcde4e7a75e3948d2f7381906e13990953de/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/7933ee21dbd84baf3428338f457ff79a4dbb0d016e019074a2a989e2a98448ab/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/7457a8518079b880eb03968a4ef36975753efa6f72255310cf460410171f7a85/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/ba06a9398af67217064c26cd88b57907268f31c745b258a12d75501132551df5/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/4ad83a8005a0521aec367ad4b9330f8de051d0c2c2fffa85c76416968d566e29/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/879e39d39e17b1e4731c855ab03d3ba3f729ba2748ffbf65d0a7d37ca86c1e37/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/ea6b2bc999f38de080d4559d054cc3f0eaefc551770e732f3f92f368c2663987/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/33ef75dde87472a837e23b95d2ed5dcfa9eefa3d85997668cd8ca8b03d2067e2/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/4a522004ed7b27a021a9e00ce03f3e71cdbd7808c17ca626a9a6dea90dfc8257/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/f30cec807155ea82558e77b60f9bc01d185f15ea23f4a55d80349a8d721b893b/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/2d92a8a4956b09f3b3f36790f62a20edfd5f728b4539b7c898a4fff7d402cf82/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/c121d517380e8f74d37d4edd389ab8e5677f2522cf737465ed20b4fc7142281d/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/ce2f7becb52e29104f7264d39540b05590b0388c0b7a23cdd4d20dd651fdb760/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/045d99b8759e7fc34ee2000a8fa5be93b3c98d13abf2595942eac15dc5d97ebb/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/06975e92589ab9b24c8652d54c4e020877d8bb9096007eb6e637ef06fef72b49/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/c8a34f991ed190da352ef35f7db31e9d6ea9f596144a95978b81d88202e44fba/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/2b2c10259dc770f281dba258c8923e8a4856df6a8f99a4aadfa813a112d004bb/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/838fbc7385f142075fd11202421d96978d95a283469356e47af9653825f5407f/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/030736defa3f4c4e7f9f1f7f82aeaecebaf8e5af03c9296bdda23e0cb6d4414f/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/6b57f2f9572e68acc25d1dfc12c822754d58dfe298733a508023dedb1e9d2e0e/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/358d45a30bba297d4afe96ac4c33b81ae62a6b9edb77a95972115ca2f10c2de3/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/b1b55eeeb39304dffa4c94734c10e18680732f17170942381cb9277d54c563f0/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/632fad778cdefbc05dc446db99da8f061d2a22879d4e106464c0e667b6c43a90/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/c63f53fc124e031a7fc4c69421673ee4c3666dc8e01f4241697cdedd713191b8/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/280249a8e2ad00f52dd3175508d57668cfe60993119724f06899c9f00e068559/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/f4fc43ec61e0a6211ec26bdc337cdf34f5826cf855b1986d33bf11f6c4803daf/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/f4fc0f64b78175094fe603882f5ac2f334a94c56e7d1eee01ae1bf5dc034e90d/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/0456d7b1f926dd4a612c9a148f8bb47d871c73939f6b28cdcfb2710d72bd3d42/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/c2bc0de76e13d6f40cfaab21f7a6927152864e51c3c113f28987ac05e9be403c/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/2eccf9906432450e6aceb1a741b4d8e4161ddde4d03f2636e6c45bc5c04b6eb2/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/9939fd6af4ba48d5c80c3d0ed145af0ba2984a28c53515129687b11e0db5e5e1/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/d2ad94375517f20ae6239ab6450be6223d0a9ebb026e8ccc4e500e6dae2573de/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/bcbc9acc8fb6abd0f5e0110bc56a1800b7165b7ae00d4b54ff0ad9f251219ebb/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/b365d75ffbe5e3c97b0d686077b20a70ad5ee0b251e59d486fac3281b550f77b/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/e97219bf12f28b3c549513b4fe309ea5f860c7da3a5c2125b4efd20fa1e1b9f4/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/ee06ad17871cf4427f7e56cddff432a6219d43d915eb8f6e1ca4cf64a075dfb4/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/e38278f83401e62d9783d805760e3be3ae11b965e93bb55a2b54d916e696807c/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 06:56:37.369294 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.368925    5073 manager.go:217] Machine: {Timestamp:2026-10-30 06:56:37.368464492 +0000 UTC m=+0.076344651 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100112 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7e1bc14d444450c1e81fc25095bd SystemUUID:ec2c7e1b-c14d-4444-50c1-e81fc25095bd BootID:b36f6997-09fe-40c8-9fb4-8264e970d9e6 Filesystems:[{Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~projected/kube-api-access-5nnws DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b/volumes/kubernetes.io~projected/kube-api-access-ps8pz DeviceMajor:0 DeviceMinor:295 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3a361442-634d-4ff5-990a-29095aa6264d/volumes/kubernetes.io~projected/kube-api-access-chrf4 DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/084aaf720ff93c80ccbb8d0d60f7183a68339cc4a93d286b7ee202bfb8eed100/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3311dd401b64fcdee682205ee062930977e39860f7681a3a0f4744f7c1714373/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a890cebd9d21e4b967ab90b3577c7e7c4da438e598e8fc1ce39e1e889255df07/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/10492054-f044-4bee-93c4-e316fc500bff/volumes/kubernetes.io~projected/kube-api-access-zhntt DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volumes/kubernetes.io~projected/kube-api-access-pvfcl DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba8aff5544900b0d176f89d89247d581fe13c7338c778dfa084a61e661737802/userdata/shm DeviceMajor:0 DeviceMinor:221 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4/volumes/kubernetes.io~projected/kube-api-access-b6r4j DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a733e34a-1603-4bd5-8ef0-5ff872027fa6/volumes/kubernetes.io~projected/kube-api-access-r9vdm DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:235 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ecc03f1bcd0f7ebf2cdfd973536d7c3553554bd61b19a288461cba0b8f936484/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/099c00ac-0c53-4bd5-be8f-de38e33f705e/volumes/kubernetes.io~projected/kube-api-access-5v2dp DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/10557618fc782de580c91fdbef68203e3caccb3e668b294428ede8db2d530da5/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8d16b2df-cd08-4dd3-a1b3-88274a827068/volumes/kubernetes.io~projected/kube-api-access-mts4p DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96156c02-8e1f-4612-b919-b20007fe0dda/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/af38d809-602c-4cd6-a630-600a1400f605/volumes/kubernetes.io~projected/kube-api-access-l9rnd DeviceMajor:0 DeviceMinor:309 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9e54b74c-ba81-405b-9002-c7ff8719e93d/volumes/kubernetes.io~projected/kube-api-access-dqk66 DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/88abcbca-0455-472c-ab5a-6bd2a50d4544/volumes/kubernetes.io~projected/kube-api-access-kz9px DeviceMajor:0 DeviceMinor:229 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74ef3d75fdf13ac9767d6238c8133ad861d58cce320b3d680618b4b838d6260e/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/df38da75-f716-4dd4-a6eb-f736d0d2ac6c/volumes/kubernetes.io~projected/kube-api-access-xc6w6 DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a45a4f45-8253-4317-82ca-9edf34f33dbd/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/10bb054eb4f45a6462c3d5fbc1c305f90bd083a239cfdbfc978516c522032923/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/51d62594-4baa-4505-9f8a-ab165b3b1ba0/volumes/kubernetes.io~projected/kube-api-access-sgsds DeviceMajor:0 DeviceMinor:308 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9827e910e9c550d42b0c8809f87a7e7a46ea5a3b880a06043c5b0d7b90586b5b/userdata/shm DeviceMajor:0 DeviceMinor:356 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2d9f695-6bb2-433a-862a-3e626fedbe8e/volumes/kubernetes.io~projected/kube-api-access-nz9xb DeviceMajor:0 DeviceMinor:355 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/497c3d29-4ad7-4314-b73a-8015ea05057f/volumes/kubernetes.io~projected/kube-api-access-mx76m DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f1c149b5-13ba-423f-a970-98da3c328798/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/609ce248-2b9f-4fc1-b23a-b075ca520a3e/volumes/kubernetes.io~projected/kube-api-access-jmlgf DeviceMajor:0 DeviceMinor:332 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/46375128-278b-46e4-ace2-13374ad65d23/volumes/kubernetes.io~projected/kube-api-access-2kbp6 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~projected/kube-api-access-x6tvh DeviceMajor:0 DeviceMinor:233 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/volumes/kubernetes.io~projected/kube-api-access-h8vf7 DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e34614b0-e9e0-48fa-ae70-99404431cc66/volumes/kubernetes.io~projected/kube-api-access-z5g9l DeviceMajor:0 DeviceMinor:237 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f43f97049c89140b34b8b3b6b26b95e2d26af56a5fa2ad31b9ad36a86c87ac2b/userdata/shm DeviceMajor:0 DeviceMinor:293 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dae48309-e15e-4919-a6d3-051758b7a23e/volumes/kubernetes.io~projected/kube-api-access-tgp67 DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b685a38e621e515c6f9b13ba066f2e4ae5f333719aaf8c2e27a821cb64800913/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/88abcbca-0455-472c-ab5a-6bd2a50d4544/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/04664ebb-d94a-4bfe-a346-b441a7da0e3f/volumes/kubernetes.io~projected/kube-api-access-n2pv7 DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/580c167c-2e1f-4dbd-86b2-4412e856f1c2/volumes/kubernetes.io~projected/kube-api-access-h2lml DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96156c02-8e1f-4612-b919-b20007fe0dda/volumes/kubernetes.io~projected/kube-api-access-chsqg DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69d7578b79ed7a30501c137d2472a54d36910a555e7cc45aa04a38c7d62a9a24/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/249bddc4b7366f7cb494499bac5a4075e2fdaa17dba654b4317bf9832db2e8a9/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/06b723aaf077e788af59ead2800b05c5dfa3f5b542a081bb0ff35cbde74325d2/userdata/shm DeviceMajor:0 DeviceMinor:325 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2186b550fed07d573a5bdc3c25ac91539bed966b82aa48edd2a1e939b85904e6/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3a361442-634d-4ff5-990a-29095aa6264d/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b23a23e6-395f-4501-aab1-be26e3ff2236/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3327489-8c96-4b81-b440-fd58d4d2fd0b/volumes/kubernetes.io~projected/kube-api-access-xjqmx DeviceMajor:0 DeviceMinor:310 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e2d9f695-6bb2-433a-862a-3e626fedbe8e/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:350 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3ff653e2ef09d25d24f9d8ee2ad8d56cd2b59ee89882ce867a1379fe9c9f6641/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~projected/kube-api-access-jd9pc DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6db22c6bb2c0361b43a8a12b22605bdd4b29f83c88ee807cf765508a58a167c5/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/103c2eacdb0e17bb26e7b1b87903478133f0a1c0a7961f880658a22e80238254/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~projected/kube-api-access-lrfg2 DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/95661150-16a9-4b3a-9660-9ad8feaa09a9/volumes/kubernetes.io~projected/kube-api-access-f6cwg DeviceMajor:0 DeviceMinor:236 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/334689c1-93d2-4b74-8d46-20890f606782/volumes/kubernetes.io~projected/kube-api-access-47gx5 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c30516b149097c8d0ef03d7d7af0de911603a8df11dca8a5e113b948741b4689/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792/volumes/kubernetes.io~projected/kube-api-access-s5255 DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a3e1b62f14c923614bb07faa2f475a60e8e2f3f83a6a3f415ad76de17c3871b9/userdata/shm DeviceMajor:0 DeviceMinor:326 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f38e4bfa-c76a-459a-b0c2-2f731ca919fc/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-184 DeviceMajor:0 DeviceMinor:184 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e9017647d7dd0a58552200b9f42ea77a1ef798e5249034ad268e3072ecd70237/userdata/shm DeviceMajor:0 DeviceMinor:333 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/baaa9ce67de7d65c84bb3cdcb409d613fe548e1cac5ed074133fa41c5a16f91e/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ab046f8fda91fcf833b121f8204ed87606d6ad13ebac99d18c83b00550e1527b/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5d01ad1b-d546-48f6-b5b8-980de74eb623/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41cc1e4553dc8ec0409646813479bc01346965ff16ce68fde64dedea8d862590/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:06b723aaf077e78 MacAddress:c2:66:b4:88:6b:62 Speed:10000 Mtu:8901} {Name:084aaf720ff93c8 MacAddress:62:35:19:30:34:3e Speed:10000 Mtu:8901} {Name:103c2eacdb0e17b MacAddress:0a:69:20:ae:8b:6c Speed:10000 Mtu:8901} {Name:10bb054eb4f45a6 MacAddress:0e:69:f9:c8:8e:5b Speed:10000 Mtu:8901} {Name:2186b550fed07d5 MacAddress:42:db:77:50:80:2c Speed:10000 Mtu:8901} {Name:249bddc4b7366f7 MacAddress:3a:73:a4:c2:a8:05 Speed:10000 Mtu:8901} {Name:3ff653e2ef09d25 MacAddress:42:d3:e9:a1:70:7b Speed:10000 Mtu:8901} {Name:69d7578b79ed7a3 MacAddress:2a:92:9e:7d:5d:95 Speed:10000 Mtu:8901} {Name:74ef3d75fdf13ac MacAddress:9e:c2:ff:4e:b9:ff Speed:10000 Mtu:8901} {Name:9827e910e9c550d MacAddress:1e:28:ac:48:f4:4c Speed:10000 Mtu:8901} {Name:a3e1b62f14c9236 MacAddress:a6:67:85:b1:0f:ac Speed:10000 Mtu:8901} {Name:ab046f8fda91fcf MacAddress:f6:12:f1:b7:17:10 Speed:10000 Mtu:8901} {Name:ba8aff5544900b0 MacAddress:32:bd:4f:0c:3c:f7 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d2:30:65:fb Speed:0 Mtu:9001} {Name:br-int MacAddress:de:48:db:b0:df:43 Speed:0 Mtu:8901} {Name:e9017647d7dd0a5 MacAddress:3e:44:61:6c:2a:a4 Speed:10000 Mtu:8901} {Name:ecc03f1bcd0f7eb MacAddress:6e:4c:12:94:9c:2d Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d2:30:65:fb Speed:0 Mtu:9001} {Name:f43f97049c89140 MacAddress:d2:cc:61:39:5d:4c Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:6a:85:ca:d1:f9:b0 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ea:f3:35:89:c6:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 06:56:37.369520 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369297    5073 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 06:56:37.369520 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369343    5073 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 06:56:37.369625 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369604    5073 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 06:56:37.369755 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369626    5073 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 06:56:37.369802 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369757    5073 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 06:56:37.369802 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369765    5073 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 06:56:37.369802 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369775    5073 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 06:56:37.369802 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369788    5073 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 06:56:37.369919 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369807    5073 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 06:56:37.369974 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.369964    5073 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 06:56:37.370077 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.370068    5073 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 06:56:37.370110 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.370102    5073 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 06:56:37.370137 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.370110    5073 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 06:56:37.370137 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.370120    5073 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 06:56:37.370137 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.370129    5073 kubelet.go:405] "Adding apiserver pod source"
Oct 30 06:56:37.370137 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.370137    5073 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 06:56:37.371482 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.371466    5073 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 06:56:37.371482 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.371479    5073 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 06:56:37.373649 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.372389    5073 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 06:56:37.375831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.375812    5073 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 06:56:37.375831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.375829    5073 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 06:56:37.376014 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.375998    5073 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 06:56:37.376219 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376203    5073 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 06:56:37.376281 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376244    5073 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 06:56:37.376375 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376356    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376385    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376397    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376406    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376415    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376423    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376432    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376441    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 06:56:37.376452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376451    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 06:56:37.376805 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376460    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 06:56:37.376805 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376474    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 06:56:37.376805 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376489    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 06:56:37.376805 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376524    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 06:56:37.376805 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.376534    5073 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 06:56:37.380005 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.379990    5073 server.go:1263] "Started kubelet"
Oct 30 06:56:37.380452 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.380400    5073 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 06:56:37.380532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.380468    5073 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 06:56:37.380485 ip-10-0-132-33 systemd[1]: Started Kubernetes Kubelet.
Oct 30 06:56:37.381378 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.380763    5073 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 06:56:37.381378 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.381198    5073 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 06:56:37.382684 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.382664    5073 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 06:56:37.384177 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384161    5073 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 06:56:37.384275 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384177    5073 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 06:56:37.384353 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384293    5073 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 06:56:37.384353 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384275    5073 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 06:50:57 +0000 UTC" deadline="2028-05-19 01:25:33.281403108 +0000 UTC"
Oct 30 06:56:37.384353 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384312    5073 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 06:56:37.384353 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384311    5073 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13602h28m55.897095942s"
Oct 30 06:56:37.384353 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.384303    5073 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.385910    5073 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-33.ec2.internal\" not found"
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387532    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387572    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387585    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f38e4bfa-c76a-459a-b0c2-2f731ca919fc" volumeName="kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-tmp" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387603    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="95661150-16a9-4b3a-9660-9ad8feaa09a9" volumeName="kubernetes.io/projected/95661150-16a9-4b3a-9660-9ad8feaa09a9-kube-api-access-f6cwg" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387614    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3327489-8c96-4b81-b440-fd58d4d2fd0b" volumeName="kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387626    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10492054-f044-4bee-93c4-e316fc500bff" volumeName="kubernetes.io/configmap/10492054-f044-4bee-93c4-e316fc500bff-config-volume" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387637    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="334689c1-93d2-4b74-8d46-20890f606782" volumeName="kubernetes.io/projected/334689c1-93d2-4b74-8d46-20890f606782-kube-api-access-47gx5" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387649    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580c167c-2e1f-4dbd-86b2-4412e856f1c2" volumeName="kubernetes.io/projected/580c167c-2e1f-4dbd-86b2-4412e856f1c2-kube-api-access-h2lml" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387663    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387674    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a45a4f45-8253-4317-82ca-9edf34f33dbd" volumeName="kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387698    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3327489-8c96-4b81-b440-fd58d4d2fd0b" volumeName="kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387711    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2d9f695-6bb2-433a-862a-3e626fedbe8e" volumeName="kubernetes.io/projected/e2d9f695-6bb2-433a-862a-3e626fedbe8e-kube-api-access-nz9xb" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387724    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1c149b5-13ba-423f-a970-98da3c328798" volumeName="kubernetes.io/secret/f1c149b5-13ba-423f-a970-98da3c328798-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387736    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="334689c1-93d2-4b74-8d46-20890f606782" volumeName="kubernetes.io/empty-dir/334689c1-93d2-4b74-8d46-20890f606782-tmp-dir" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387749    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" volumeName="kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-config" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387761    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b" volumeName="kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387772    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1c149b5-13ba-423f-a970-98da3c328798" volumeName="kubernetes.io/projected/f1c149b5-13ba-423f-a970-98da3c328798-kube-api-access-pvfcl" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387790    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04664ebb-d94a-4bfe-a346-b441a7da0e3f" volumeName="kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cni-binary-copy" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387802    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387814    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88abcbca-0455-472c-ab5a-6bd2a50d4544" volumeName="kubernetes.io/configmap/88abcbca-0455-472c-ab5a-6bd2a50d4544-config" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387828    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387839    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3327489-8c96-4b81-b440-fd58d4d2fd0b" volumeName="kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387875    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e34614b0-e9e0-48fa-ae70-99404431cc66" volumeName="kubernetes.io/configmap/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-config" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387888    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" volumeName="kubernetes.io/secret/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-serving-cert" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387903    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96156c02-8e1f-4612-b919-b20007fe0dda" volumeName="kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-tmp" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387914    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3327489-8c96-4b81-b440-fd58d4d2fd0b" volumeName="kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387924    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dae48309-e15e-4919-a6d3-051758b7a23e" volumeName="kubernetes.io/configmap/dae48309-e15e-4919-a6d3-051758b7a23e-serviceca" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387936    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51d62594-4baa-4505-9f8a-ab165b3b1ba0" volumeName="kubernetes.io/empty-dir/51d62594-4baa-4505-9f8a-ab165b3b1ba0-data-volume" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387952    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387963    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a733e34a-1603-4bd5-8ef0-5ff872027fa6" volumeName="kubernetes.io/projected/a733e34a-1603-4bd5-8ef0-5ff872027fa6-kube-api-access-r9vdm" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387975    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b23a23e6-395f-4501-aab1-be26e3ff2236" volumeName="kubernetes.io/secret/b23a23e6-395f-4501-aab1-be26e3ff2236-agent-certs" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.387988    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1c149b5-13ba-423f-a970-98da3c328798" volumeName="kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-config" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388001    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="099c00ac-0c53-4bd5-be8f-de38e33f705e" volumeName="kubernetes.io/projected/099c00ac-0c53-4bd5-be8f-de38e33f705e-kube-api-access-5v2dp" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388016    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e34614b0-e9e0-48fa-ae70-99404431cc66" volumeName="kubernetes.io/projected/e34614b0-e9e0-48fa-ae70-99404431cc66-kube-api-access-z5g9l" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388029    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792" volumeName="kubernetes.io/secret/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-serving-cert" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388041    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04664ebb-d94a-4bfe-a346-b441a7da0e3f" volumeName="kubernetes.io/projected/04664ebb-d94a-4bfe-a346-b441a7da0e3f-kube-api-access-n2pv7" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388049    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46375128-278b-46e4-ace2-13374ad65d23" volumeName="kubernetes.io/projected/46375128-278b-46e4-ace2-13374ad65d23-kube-api-access-2kbp6" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388057    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d01ad1b-d546-48f6-b5b8-980de74eb623" volumeName="kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-stats-auth" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388064    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e54b74c-ba81-405b-9002-c7ff8719e93d" volumeName="kubernetes.io/projected/9e54b74c-ba81-405b-9002-c7ff8719e93d-kube-api-access-dqk66" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388070    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388077    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388084    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b23a23e6-395f-4501-aab1-be26e3ff2236" volumeName="kubernetes.io/configmap/b23a23e6-395f-4501-aab1-be26e3ff2236-konnectivity-ca" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388092    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388100    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" volumeName="kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-trusted-ca" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388108    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96156c02-8e1f-4612-b919-b20007fe0dda" volumeName="kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388115    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388122    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af38d809-602c-4cd6-a630-600a1400f605" volumeName="kubernetes.io/projected/af38d809-602c-4cd6-a630-600a1400f605-kube-api-access-l9rnd" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388129    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dae48309-e15e-4919-a6d3-051758b7a23e" volumeName="kubernetes.io/projected/dae48309-e15e-4919-a6d3-051758b7a23e-kube-api-access-tgp67" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388139    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2d9f695-6bb2-433a-862a-3e626fedbe8e" volumeName="kubernetes.io/secret/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-key" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388148    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f38e4bfa-c76a-459a-b0c2-2f731ca919fc" volumeName="kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-tuned" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388155    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580c167c-2e1f-4dbd-86b2-4412e856f1c2" volumeName="kubernetes.io/configmap/580c167c-2e1f-4dbd-86b2-4412e856f1c2-iptables-alerter-script" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388163    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04664ebb-d94a-4bfe-a346-b441a7da0e3f" volumeName="kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-daemon-config" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388170    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10492054-f044-4bee-93c4-e316fc500bff" volumeName="kubernetes.io/empty-dir/10492054-f044-4bee-93c4-e316fc500bff-tmp-dir" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388178    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a361442-634d-4ff5-990a-29095aa6264d" volumeName="kubernetes.io/secret/3a361442-634d-4ff5-990a-29095aa6264d-cert" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388187    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388196    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" volumeName="kubernetes.io/projected/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-kube-api-access-h8vf7" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388210    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d16b2df-cd08-4dd3-a1b3-88274a827068" volumeName="kubernetes.io/projected/8d16b2df-cd08-4dd3-a1b3-88274a827068-kube-api-access-mts4p" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388217    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96156c02-8e1f-4612-b919-b20007fe0dda" volumeName="kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-snapshots" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388225    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="609ce248-2b9f-4fc1-b23a-b075ca520a3e" volumeName="kubernetes.io/projected/609ce248-2b9f-4fc1-b23a-b075ca520a3e-kube-api-access-jmlgf" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388233    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388242    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96156c02-8e1f-4612-b919-b20007fe0dda" volumeName="kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-service-ca-bundle" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388250    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96156c02-8e1f-4612-b919-b20007fe0dda" volumeName="kubernetes.io/secret/96156c02-8e1f-4612-b919-b20007fe0dda-serving-cert" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388258    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a47ad62b-dd57-4c62-bc04-c688238cbe85" volumeName="kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388267    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acb49735-f2be-44e2-92f2-65f68a386864" volumeName="kubernetes.io/configmap/acb49735-f2be-44e2-92f2-65f68a386864-nginx-conf" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388274    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df38da75-f716-4dd4-a6eb-f736d0d2ac6c" volumeName="kubernetes.io/configmap/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-telemetry-config" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388283    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f38e4bfa-c76a-459a-b0c2-2f731ca919fc" volumeName="kubernetes.io/projected/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-kube-api-access-jd9pc" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388290    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a361442-634d-4ff5-990a-29095aa6264d" volumeName="kubernetes.io/projected/3a361442-634d-4ff5-990a-29095aa6264d-kube-api-access-chrf4" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388299    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b33b614-d743-45a3-a9e0-117db6e23f6e" volumeName="kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388308    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96156c02-8e1f-4612-b919-b20007fe0dda" volumeName="kubernetes.io/projected/96156c02-8e1f-4612-b919-b20007fe0dda-kube-api-access-chsqg" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388317    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2d9f695-6bb2-433a-862a-3e626fedbe8e" volumeName="kubernetes.io/configmap/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-cabundle" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388324    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1c149b5-13ba-423f-a970-98da3c328798" volumeName="kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388332    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1c149b5-13ba-423f-a970-98da3c328798" volumeName="kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-env-overrides" seLinuxMountContext=""
Oct 30 06:56:37.388605 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388310    5073 factory.go:55] Registering systemd factory
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388978    5073 factory.go:223] Registration of the systemd container factory successfully
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.388525    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792" volumeName="kubernetes.io/projected/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-kube-api-access-s5255" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389175    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46375128-278b-46e4-ace2-13374ad65d23" volumeName="kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389194    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88abcbca-0455-472c-ab5a-6bd2a50d4544" volumeName="kubernetes.io/projected/88abcbca-0455-472c-ab5a-6bd2a50d4544-kube-api-access-kz9px" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389215    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df38da75-f716-4dd4-a6eb-f736d0d2ac6c" volumeName="kubernetes.io/projected/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-kube-api-access-xc6w6" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389227    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe045d03-9b1b-4d8c-bc20-bc50f21a60e4" volumeName="kubernetes.io/projected/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kube-api-access-b6r4j" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389259    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46375128-278b-46e4-ace2-13374ad65d23" volumeName="kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-binary-copy" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389273    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10492054-f044-4bee-93c4-e316fc500bff" volumeName="kubernetes.io/projected/10492054-f044-4bee-93c4-e316fc500bff-kube-api-access-zhntt" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389286    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="497c3d29-4ad7-4314-b73a-8015ea05057f" volumeName="kubernetes.io/projected/497c3d29-4ad7-4314-b73a-8015ea05057f-kube-api-access-mx76m" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389304    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88abcbca-0455-472c-ab5a-6bd2a50d4544" volumeName="kubernetes.io/secret/88abcbca-0455-472c-ab5a-6bd2a50d4544-serving-cert" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389317    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792" volumeName="kubernetes.io/configmap/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-config" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389334    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46375128-278b-46e4-ace2-13374ad65d23" volumeName="kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389345    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51d62594-4baa-4505-9f8a-ab165b3b1ba0" volumeName="kubernetes.io/projected/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-api-access-sgsds" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389357    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d01ad1b-d546-48f6-b5b8-980de74eb623" volumeName="kubernetes.io/projected/5d01ad1b-d546-48f6-b5b8-980de74eb623-kube-api-access-lrfg2" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389386    5073 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d01ad1b-d546-48f6-b5b8-980de74eb623" volumeName="kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-default-certificate" seLinuxMountContext=""
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389398    5073 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 06:56:37.391864 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.389405    5073 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 06:56:37.392554 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.391947    5073 factory.go:153] Registering CRI-O factory
Oct 30 06:56:37.392554 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.391967    5073 factory.go:223] Registration of the crio container factory successfully
Oct 30 06:56:37.392554 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.392512    5073 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 06:56:37.392554 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.392537    5073 factory.go:103] Registering Raw factory
Oct 30 06:56:37.392676 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.392558    5073 manager.go:1199] Started watching for new ooms in manager
Oct 30 06:56:37.393454 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.393437    5073 manager.go:319] Starting recovery of all containers
Oct 30 06:56:37.412293 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.412264    5073 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 06:56:37.413676 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.413651    5073 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 06:56:37.413676 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.413676    5073 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 06:56:37.413819 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.413696    5073 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 06:56:37.413819 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.413742    5073 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 06:56:37.416558 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.416527    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/1.log"
Oct 30 06:56:37.416653 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.416555    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/1.log"
Oct 30 06:56:37.425780 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.425757    5073 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:56:37.431949 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.431929    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/1.log"
Oct 30 06:56:37.432058 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.431963    5073 generic.go:356] "Generic (PLEG): container finished" podID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef" exitCode=255
Oct 30 06:56:37.437071 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.437052    5073 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 06:56:37.438614 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.438579    5073 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:56:37.448497 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.448477    5073 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:56:37.448929 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.448839    5073 generic.go:356] "Generic (PLEG): container finished" podID="747e6823a71c3697d810e3c5e2c39baa" containerID="8d9c7638a6d8da603b00e376817b431116540f87dfc458ae4db52db197673e02" exitCode=0
Oct 30 06:56:37.449908 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.449885    5073 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 06:56:37.470274 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.470249    5073 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="3c616ea2bf45c1dddccddf85d2764a9d843b565f0afb30d1a8ba1152ce6d76d1" exitCode=0
Oct 30 06:56:37.470274 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.470275    5073 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="9599b679b6bb7e51b2ed4e436e3b012a931613c4887b0bd28e5d3a14334a21a5" exitCode=0
Oct 30 06:56:37.470389 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.470282    5073 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="e0df243979514b1a3dda8be7dc4aad29d24814a8f7b0ffe40084f28e5b7146d6" exitCode=0
Oct 30 06:56:37.470389 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.470291    5073 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="63e36f66d8c0e7eeacaf67266c46f39ebdb721db0b42702d03cfa2d6c780452b" exitCode=0
Oct 30 06:56:37.470389 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.470298    5073 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="d23e3a943391b8b381020ab3f033dfcc9992752f310152741ea3f83e26ed9476" exitCode=0
Oct 30 06:56:37.470389 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.470303    5073 generic.go:356] "Generic (PLEG): container finished" podID="46375128-278b-46e4-ace2-13374ad65d23" containerID="3229b46cc5ae497fd7df3dea2806c1a1c4f829e0227cd6acf5f5b5691d758e43" exitCode=0
Oct 30 06:56:37.493036 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.492987    5073 manager.go:324] Recovery completed
Oct 30 06:56:37.514290 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.514257    5073 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 06:56:37.515103 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515081    5073 cpu_manager.go:226] "Starting" policy="none"
Oct 30 06:56:37.515103 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515097    5073 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 06:56:37.515222 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515119    5073 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 06:56:37.515253 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515238    5073 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 06:56:37.515281 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515248    5073 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 06:56:37.515281 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515266    5073 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 06:56:37.515281 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515274    5073 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 06:56:37.515281 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515281    5073 policy_none.go:50] "Start"
Oct 30 06:56:37.515388 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515292    5073 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 06:56:37.515388 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.515303    5073 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 06:56:37.518169 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.518155    5073 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 06:56:37.518206 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.518169    5073 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 06:56:37.518206 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.518176    5073 policy_none.go:44] "Start"
Oct 30 06:56:37.522460 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.522428    5073 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 06:56:37.525095 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525079    5073 manager.go:341] "Starting Device Plugin manager"
Oct 30 06:56:37.525527 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.525106    5073 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 06:56:37.525527 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525525    5073 server.go:87] "Starting device plugin registration server"
Oct 30 06:56:37.525688 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525677    5073 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 06:56:37.525740 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525687    5073 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 06:56:37.525796 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525771    5073 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 06:56:37.525904 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525873    5073 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 06:56:37.525980 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525916    5073 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 06:56:37.525980 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525923    5073 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 06:56:37.526075 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.525987    5073 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T06:56:37.525900923Z","UUID":"cb0d295d-114a-4a45-ab27-6e2db02bff16","Handler":null,"Name":"","Endpoint":""}
Oct 30 06:56:37.527219 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.527200    5073 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 06:56:37.527331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.527228    5073 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 06:56:37.527924 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.527905    5073 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 06:56:37.626586 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.626559    5073 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 06:56:37.627703 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.627686    5073 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 06:56:37.627786 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.627714    5073 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 06:56:37.627786 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.627725    5073 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-33.ec2.internal" event="NodeHasSufficientPID"
Oct 30 06:56:37.627786 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.627775    5073 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.662544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.662521    5073 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.662628 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.662592    5073 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.715322 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.715235    5073 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"]
Oct 30 06:56:37.715964 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.715917    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"747e6823a71c3697d810e3c5e2c39baa","Type":"ContainerStarted","Data":"66ad923316b06dfb04da18ebfb5171667dc76d4e8f75d26e123842213134d8d1"}
Oct 30 06:56:37.716093 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.715968    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"747e6823a71c3697d810e3c5e2c39baa","Type":"ContainerDied","Data":"8d9c7638a6d8da603b00e376817b431116540f87dfc458ae4db52db197673e02"}
Oct 30 06:56:37.716093 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.715989    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal" event={"ID":"747e6823a71c3697d810e3c5e2c39baa","Type":"ContainerStarted","Data":"c01a2f7dedb064d763f415b799ff5c0b599987b100cf5176af29a6c6e75e5b86"}
Oct 30 06:56:37.716093 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.716058    5073 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.716093 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.716068    5073 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.716093 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.716082    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" event={"ID":"a762c70289af1190dfbc46ead76d62e3","Type":"ContainerStarted","Data":"3fd82a20110c8560213fc414af74caafa1926ddfa7b7e6b2d37c464a684adbbc"}
Oct 30 06:56:37.716280 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.716103    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal" event={"ID":"a762c70289af1190dfbc46ead76d62e3","Type":"ContainerStarted","Data":"54cdee02ac0e7e81fa4318268125d64ec0df8d583f9947e9bd634fb3ce7435c2"}
Oct 30 06:56:37.740174 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.740153    5073 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 06:56:37.740294 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.740197    5073 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.740617 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.740602    5073 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 06:56:37.740658 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:37.740641    5073 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.839045 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.838974    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.839045 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.839011    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.839045 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.839032    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a762c70289af1190dfbc46ead76d62e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"a762c70289af1190dfbc46ead76d62e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.939601 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.939565    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.939765 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.939609    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a762c70289af1190dfbc46ead76d62e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"a762c70289af1190dfbc46ead76d62e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.939765 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.939636    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.939765 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.939683    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.939765 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.939704    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747e6823a71c3697d810e3c5e2c39baa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" (UID: \"747e6823a71c3697d810e3c5e2c39baa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:37.939765 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:37.939730    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a762c70289af1190dfbc46ead76d62e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" (UID: \"a762c70289af1190dfbc46ead76d62e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:38.370987 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.370960    5073 apiserver.go:52] "Watching apiserver"
Oct 30 06:56:38.421561 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.421532    5073 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 06:56:38.422240 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.422218    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6","openshift-multus/multus-2snxl","openshift-cluster-node-tuning-operator/tuned-hvtgp","openshift-image-registry/image-registry-6b74f6655f-cf7cw","openshift-image-registry/node-ca-fnh8d","openshift-network-operator/iptables-alerter-p6pb4","openshift-console-operator/console-operator-7cd56b8dbc-m59nb","openshift-image-registry/image-registry-8b55fb966-6lrtj","kube-system/global-pull-secret-syncer-mvld4","kube-system/kas-connection-checker-685895c7c9-9x2q4","openshift-insights/periodic-gathering-v9xr8-jmxsw","kube-system/kas-connection-checker-685895c7c9-rns6c","openshift-network-console/networking-console-plugin-86c478bb88-b7r65","openshift-insights/insights-operator-7c4986d449-95gsq","openshift-insights/insights-runtime-extractor-w9vw6","openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7","openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56","kube-system/konnectivity-agent-thvhj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v","openshift-dns/node-resolver-kg9qk","openshift-dns/dns-default-l6xts","openshift-ovn-kubernetes/ovnkube-node-zm7qp","openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb","openshift-ingress-canary/ingress-canary-xghrm","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal","openshift-multus/multus-additional-cni-plugins-qn9r5","openshift-network-diagnostics/network-check-target-jlk9l","openshift-multus/network-metrics-daemon-76th7","openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x","kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal","openshift-service-ca/service-ca-5fffc97bdf-ft8fb","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9","kube-system/kas-connection-checker-685895c7c9-8ghnm","openshift-ingress/router-default-789654ff5-xkswj"]
Oct 30 06:56:38.423642 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.423615    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.425742 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.425721    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.426304 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.426280    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.428836 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.428816    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.429638 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.429619    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:38.433583 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.433565    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:38.434891 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.434878    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.435326 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.435312    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.436426 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.436399    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.436426 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.436417    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.437118 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.437100    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.437642 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.437628    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 06:56:38.437718 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.437679    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.437718 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.437693    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 06:56:38.438652 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.438635    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 06:56:38.438714 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.438664    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.438714 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.438674    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 06:56:38.439316 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.439295    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 06:56:38.439442 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.439326    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.439903 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.439882    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.440416 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.440397    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.440775 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.440754    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 06:56:38.449251 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.449233    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 06:56:38.449251 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.449239    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.450553 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450536    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.450959 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450935    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 06:56:38.451059 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450956    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.451059 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450975    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 06:56:38.451059 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450984    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.451059 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450986    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 06:56:38.451059 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.450960    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 06:56:38.451270 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451181    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.451270 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451266    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.451363 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451285    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 06:56:38.451363 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451297    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.451363 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451301    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 06:56:38.451489 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451445    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.451636 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451622    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.451636 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.451632    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.461999 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.461974    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 06:56:38.462066 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462012    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 06:56:38.462100 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462072    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 06:56:38.462293 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462279    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 06:56:38.462424 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462410    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 06:56:38.462957 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462939    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7szgh\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462957    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462968    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.462978    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463013    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9hhpl\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463025    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-s8tns\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463030    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 06:56:38.463062 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463049    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 06:56:38.463339 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463091    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 06:56:38.463449 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463436    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8vngf\""
Oct 30 06:56:38.463497 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463459    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 06:56:38.463497 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463482    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2tccl\""
Oct 30 06:56:38.463575 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463485    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-f2h44\""
Oct 30 06:56:38.463613 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463575    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-dpx9k\""
Oct 30 06:56:38.463613 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463584    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 06:56:38.463613 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463588    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-k58xb\""
Oct 30 06:56:38.463732 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463724    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wlntw\""
Oct 30 06:56:38.463775 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463732    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4krqm\""
Oct 30 06:56:38.463819 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463783    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 06:56:38.463877 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463819    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hkqzl\""
Oct 30 06:56:38.463877 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463844    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 06:56:38.464000 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.463988    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q4jsx\""
Oct 30 06:56:38.464071 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464056    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-44sjc\""
Oct 30 06:56:38.464071 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464066    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 06:56:38.464193 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464178    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 06:56:38.464193 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464186    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-th56t\""
Oct 30 06:56:38.464285 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464188    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 06:56:38.464285 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464200    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6h5pm\""
Oct 30 06:56:38.464285 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464254    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.464285 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464281    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 06:56:38.464458 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464293    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b8s8m\""
Oct 30 06:56:38.464458 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464315    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.464458 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464395    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.464458 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464426    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5k2w\""
Oct 30 06:56:38.464458 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464439    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464481    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464490    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464510    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464560    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464527    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464541    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464547    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464511    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6mxg\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464576    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464648    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464668    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464675    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 06:56:38.464747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464738    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.464809    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465018    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465030    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465026    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465030    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465091    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465135    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465147    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465158    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465134    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465208    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465215    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465253    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465273    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465292    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465310    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465331 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465313    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 06:56:38.465831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465346    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pptc7\""
Oct 30 06:56:38.465831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465350    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 06:56:38.465831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465428    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9dbnh\""
Oct 30 06:56:38.465831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465434    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 06:56:38.465831 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.465652    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 06:56:38.466404 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.466389    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 06:56:38.482390 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.482370    5073 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:38.482516 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.482503    5073 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:38.486494 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.486478    5073 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 06:56:38.539309 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.539292    5073 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 06:56:38.539386 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.539337    5073 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-33.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:38.539666 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.539651    5073 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 06:56:38.539709 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.539693    5073 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-33.ec2.internal"
Oct 30 06:56:38.541964 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.541943    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.542048 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.541980    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-tuned\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.542048 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542005    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-registration-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.542177 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542058    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae48309-e15e-4919-a6d3-051758b7a23e-host\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.542177 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542089    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47gx5\" (UniqueName: \"kubernetes.io/projected/334689c1-93d2-4b74-8d46-20890f606782-kube-api-access-47gx5\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.542177 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542118    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-tuned\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.542177 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542168    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cnibin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.542326 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542191    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-daemon-config\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.542326 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542218    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9px\" (UniqueName: \"kubernetes.io/projected/88abcbca-0455-472c-ab5a-6bd2a50d4544-kube-api-access-kz9px\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:38.542326 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542278    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.542446 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542425    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.542502 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542458    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10492054-f044-4bee-93c4-e316fc500bff-config-volume\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.542502 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542485    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.542597 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542505    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-daemon-config\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.542597 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542507    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.542791 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542508    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-systemd\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.542922 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542901    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc6w6\" (UniqueName: \"kubernetes.io/projected/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-kube-api-access-xc6w6\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.542986 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542948    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cni-binary-copy\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.543042 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.542996    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.543042 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543030    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-sys\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.543148 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543056    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10492054-f044-4bee-93c4-e316fc500bff-config-volume\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.543148 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543062    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-cnibin\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.543148 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543122    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.543296 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543157    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-stats-auth\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.543296 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543213    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.543296 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543245    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-var-lib-kubelet\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.543421 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543300    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cni-binary-copy\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.543421 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543359    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.543520 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543424    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-netd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.543520 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543449    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-stats-auth\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.543520 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543466    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-trusted-ca\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.543520 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543509    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:38.543710 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543544    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-modprobe-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.543710 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543590    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-host\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.543710 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543622    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.543710 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543671    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lml\" (UniqueName: \"kubernetes.io/projected/580c167c-2e1f-4dbd-86b2-4412e856f1c2-kube-api-access-h2lml\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.543710 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543703    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-env-overrides\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.543973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543752    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/334689c1-93d2-4b74-8d46-20890f606782-tmp-dir\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.543973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543787    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51d62594-4baa-4505-9f8a-ab165b3b1ba0-crio-socket\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.543973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543822    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-trusted-ca\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.543973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543835    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.543973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543889    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.543973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543923    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.543972    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-system-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544005    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-systemd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544028    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/334689c1-93d2-4b74-8d46-20890f606782-tmp-dir\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544055    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9pc\" (UniqueName: \"kubernetes.io/projected/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-kube-api-access-jd9pc\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544103    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544134    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544183    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-default-certificate\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544218    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544263    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-serving-cert\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:38.544311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544300    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-socket-dir-parent\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.544759 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544342    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2pv7\" (UniqueName: \"kubernetes.io/projected/04664ebb-d94a-4bfe-a346-b441a7da0e3f-kube-api-access-n2pv7\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.544759 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544388    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.544759 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544434    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-env-overrides\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.544759 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544437    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.544961 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.544833    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.545051 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545031    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-default-certificate\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.545142 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545126    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mts4p\" (UniqueName: \"kubernetes.io/projected/8d16b2df-cd08-4dd3-a1b3-88274a827068-kube-api-access-mts4p\") pod \"kas-connection-checker-685895c7c9-8ghnm\" (UID: \"8d16b2df-cd08-4dd3-a1b3-88274a827068\") " pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:38.545197 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545182    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-key\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:38.545253 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545211    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-cabundle\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:38.545308 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545262    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-etc-kubernetes\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.545308 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545302    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.545409 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545351    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10492054-f044-4bee-93c4-e316fc500bff-tmp-dir\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.545409 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545400    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.545618 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545603    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.545798 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.545778    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.546170 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546144    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-serving-cert\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:38.546306 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546288    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.546447 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546426    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-ovn\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.546539 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546471    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-log-socket\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.546539 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546500    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.546694 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546536    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-config\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.546694 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546593    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9rnd\" (UniqueName: \"kubernetes.io/projected/af38d809-602c-4cd6-a630-600a1400f605-kube-api-access-l9rnd\") pod \"migrator-66df5d496b-8wh56\" (UID: \"af38d809-602c-4cd6-a630-600a1400f605\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:38.546694 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546619    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.546694 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546651    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cwg\" (UniqueName: \"kubernetes.io/projected/95661150-16a9-4b3a-9660-9ad8feaa09a9-kube-api-access-f6cwg\") pod \"network-check-source-6f78d59f99-d2vr7\" (UID: \"95661150-16a9-4b3a-9660-9ad8feaa09a9\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:38.546694 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546682    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-tmp\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546710    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a361442-634d-4ff5-990a-29095aa6264d-cert\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546736    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-service-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546766    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-device-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546796    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-bin\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546921    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546942    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.546990 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.546972    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-k8s-cni-cncf-io\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547010    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-conf-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547038    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2dp\" (UniqueName: \"kubernetes.io/projected/099c00ac-0c53-4bd5-be8f-de38e33f705e-kube-api-access-5v2dp\") pod \"kas-connection-checker-685895c7c9-9x2q4\" (UID: \"099c00ac-0c53-4bd5-be8f-de38e33f705e\") " pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547070    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547103    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547136    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547135    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-cabundle\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:38.547344 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547233    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10492054-f044-4bee-93c4-e316fc500bff-tmp-dir\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.547713 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547478    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.547781 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547760    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-service-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.547833 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547812    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.548404 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.547985    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-config\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.548473 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548439    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.548540 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548521    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-tmp\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.548579 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548543    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-slash\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.548627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548579    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-kubelet\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.548676 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548653    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-serving-cert\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548754    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2d9f695-6bb2-433a-862a-3e626fedbe8e-signing-key\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548813    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbp6\" (UniqueName: \"kubernetes.io/projected/46375128-278b-46e4-ace2-13374ad65d23-kube-api-access-2kbp6\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548892    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548909    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96156c02-8e1f-4612-b919-b20007fe0dda-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.548938    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-serving-cert\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549011    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a361442-634d-4ff5-990a-29095aa6264d-cert\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549022    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.549061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549039    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.549403 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549105    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-var-lib-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.549403 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549168    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.549403 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549233    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-script-lib\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.549403 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549266    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfcl\" (UniqueName: \"kubernetes.io/projected/f1c149b5-13ba-423f-a970-98da3c328798-kube-api-access-pvfcl\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.549403 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549285    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.549590 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549572    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-config\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.549656 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549636    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-node-log\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.549712 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549681    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.549747 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549727    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1c149b5-13ba-423f-a970-98da3c328798-ovnkube-script-lib\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.549787 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549774    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgp67\" (UniqueName: \"kubernetes.io/projected/dae48309-e15e-4919-a6d3-051758b7a23e-kube-api-access-tgp67\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.549836 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549812    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-config\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.549836 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549815    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.549958 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549888    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9xb\" (UniqueName: \"kubernetes.io/projected/e2d9f695-6bb2-433a-862a-3e626fedbe8e-kube-api-access-nz9xb\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:38.550131 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.549977    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-run\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.550131 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550005    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-netns\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.550131 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550034    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.550313 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550151    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.550313 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550171    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d62594-4baa-4505-9f8a-ab165b3b1ba0-data-volume\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.550313 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550188    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-multus-certs\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.550313 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550254    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51d62594-4baa-4505-9f8a-ab165b3b1ba0-data-volume\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.550313 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550253    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx76m\" (UniqueName: \"kubernetes.io/projected/497c3d29-4ad7-4314-b73a-8015ea05057f-kube-api-access-mx76m\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550344    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acb49735-f2be-44e2-92f2-65f68a386864-nginx-conf\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550367    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550396    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/334689c1-93d2-4b74-8d46-20890f606782-hosts-file\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550420    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vf7\" (UniqueName: \"kubernetes.io/projected/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-kube-api-access-h8vf7\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550458    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-lib-modules\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550495    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acb49735-f2be-44e2-92f2-65f68a386864-nginx-conf\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550493    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqk66\" (UniqueName: \"kubernetes.io/projected/9e54b74c-ba81-405b-9002-c7ff8719e93d-kube-api-access-dqk66\") pod \"kas-connection-checker-685895c7c9-rns6c\" (UID: \"9e54b74c-ba81-405b-9002-c7ff8719e93d\") " pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:38.550544 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550514    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550554    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-config\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550582    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vdm\" (UniqueName: \"kubernetes.io/projected/a733e34a-1603-4bd5-8ef0-5ff872027fa6-kube-api-access-r9vdm\") pod \"volume-data-source-validator-58c9f5f46d-hk42v\" (UID: \"a733e34a-1603-4bd5-8ef0-5ff872027fa6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550624    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550648    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88abcbca-0455-472c-ab5a-6bd2a50d4544-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550672    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-snapshots\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550695    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96156c02-8e1f-4612-b919-b20007fe0dda-serving-cert\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550696    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-config\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550735    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550756    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-snapshots\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550774    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5255\" (UniqueName: \"kubernetes.io/projected/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-kube-api-access-s5255\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550800    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550816    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlgf\" (UniqueName: \"kubernetes.io/projected/609ce248-2b9f-4fc1-b23a-b075ca520a3e-kube-api-access-jmlgf\") pod \"migrator-66df5d496b-8tgr6\" (UID: \"609ce248-2b9f-4fc1-b23a-b075ca520a3e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550832    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.550914 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550870    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.550969    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfg2\" (UniqueName: \"kubernetes.io/projected/5d01ad1b-d546-48f6-b5b8-980de74eb623-kube-api-access-lrfg2\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551000    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551018    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88abcbca-0455-472c-ab5a-6bd2a50d4544-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551022    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysconfig\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551052    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551064    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-kubernetes\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551095    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-tmp\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551144    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96156c02-8e1f-4612-b919-b20007fe0dda-serving-cert\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551152    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a45a4f45-8253-4317-82ca-9edf34f33dbd-original-pull-secret\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551207    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-dbus\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551237    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551254    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96156c02-8e1f-4612-b919-b20007fe0dda-tmp\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551263    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-etc-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551316    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551365    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551413    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b23a23e6-395f-4501-aab1-be26e3ff2236-agent-certs\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551434    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551451    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-hostroot\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551465    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551504    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6r4j\" (UniqueName: \"kubernetes.io/projected/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kube-api-access-b6r4j\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.551532 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551532    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-kubelet\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551589    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/580c167c-2e1f-4dbd-86b2-4412e856f1c2-host-slash\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551640    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b23a23e6-395f-4501-aab1-be26e3ff2236-konnectivity-ca\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551684    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5g9l\" (UniqueName: \"kubernetes.io/projected/e34614b0-e9e0-48fa-ae70-99404431cc66-kube-api-access-z5g9l\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551714    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-system-cni-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551730    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-socket-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551744    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-bin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551760    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-conf\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551794    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551831    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b23a23e6-395f-4501-aab1-be26e3ff2236-konnectivity-ca\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551888    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551891    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b23a23e6-395f-4501-aab1-be26e3ff2236-agent-certs\") pod \"konnectivity-agent-thvhj\" (UID: \"b23a23e6-395f-4501-aab1-be26e3ff2236\") " pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.551966    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-netns\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552000    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46375128-278b-46e4-ace2-13374ad65d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552078    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88abcbca-0455-472c-ab5a-6bd2a50d4544-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552122    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-systemd-units\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552164    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-multus\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552187    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/580c167c-2e1f-4dbd-86b2-4412e856f1c2-iptables-alerter-script\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552237    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88abcbca-0455-472c-ab5a-6bd2a50d4544-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:38.552241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552243    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chrf4\" (UniqueName: \"kubernetes.io/projected/3a361442-634d-4ff5-990a-29095aa6264d-kube-api-access-chrf4\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552286    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chsqg\" (UniqueName: \"kubernetes.io/projected/96156c02-8e1f-4612-b919-b20007fe0dda-kube-api-access-chsqg\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552344    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-sys-fs\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552445    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/580c167c-2e1f-4dbd-86b2-4412e856f1c2-iptables-alerter-script\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552457    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dae48309-e15e-4919-a6d3-051758b7a23e-serviceca\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552506    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552544    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552565    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-kubelet-config\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552601    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1c149b5-13ba-423f-a970-98da3c328798-ovn-node-metrics-cert\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552645    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhntt\" (UniqueName: \"kubernetes.io/projected/10492054-f044-4bee-93c4-e316fc500bff-kube-api-access-zhntt\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552710    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgsds\" (UniqueName: \"kubernetes.io/projected/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-api-access-sgsds\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.553076 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.552808    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1c149b5-13ba-423f-a970-98da3c328798-ovn-node-metrics-cert\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.553366 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.553080    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dae48309-e15e-4919-a6d3-051758b7a23e-serviceca\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.566412 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.566391    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9px\" (UniqueName: \"kubernetes.io/projected/88abcbca-0455-472c-ab5a-6bd2a50d4544-kube-api-access-kz9px\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-89rrh\" (UID: \"88abcbca-0455-472c-ab5a-6bd2a50d4544\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh"
Oct 30 06:56:38.578920 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.578901    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2pv7\" (UniqueName: \"kubernetes.io/projected/04664ebb-d94a-4bfe-a346-b441a7da0e3f-kube-api-access-n2pv7\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.578920 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.578911    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9pc\" (UniqueName: \"kubernetes.io/projected/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-kube-api-access-jd9pc\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.579079 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.578933    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lml\" (UniqueName: \"kubernetes.io/projected/580c167c-2e1f-4dbd-86b2-4412e856f1c2-kube-api-access-h2lml\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.579079 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.578983    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mts4p\" (UniqueName: \"kubernetes.io/projected/8d16b2df-cd08-4dd3-a1b3-88274a827068-kube-api-access-mts4p\") pod \"kas-connection-checker-685895c7c9-8ghnm\" (UID: \"8d16b2df-cd08-4dd3-a1b3-88274a827068\") " pod="kube-system/kas-connection-checker-685895c7c9-8ghnm"
Oct 30 06:56:38.579183 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.579142    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9rnd\" (UniqueName: \"kubernetes.io/projected/af38d809-602c-4cd6-a630-600a1400f605-kube-api-access-l9rnd\") pod \"migrator-66df5d496b-8wh56\" (UID: \"af38d809-602c-4cd6-a630-600a1400f605\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8wh56"
Oct 30 06:56:38.579183 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.579171    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc6w6\" (UniqueName: \"kubernetes.io/projected/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-kube-api-access-xc6w6\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.579424 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.579405    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2dp\" (UniqueName: \"kubernetes.io/projected/099c00ac-0c53-4bd5-be8f-de38e33f705e-kube-api-access-5v2dp\") pod \"kas-connection-checker-685895c7c9-9x2q4\" (UID: \"099c00ac-0c53-4bd5-be8f-de38e33f705e\") " pod="kube-system/kas-connection-checker-685895c7c9-9x2q4"
Oct 30 06:56:38.579675 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.579652    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5255\" (UniqueName: \"kubernetes.io/projected/f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792-kube-api-access-s5255\") pod \"service-ca-operator-544d749c8c-tkvbb\" (UID: \"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb"
Oct 30 06:56:38.579748 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.579726    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.579973 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.579930    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cwg\" (UniqueName: \"kubernetes.io/projected/95661150-16a9-4b3a-9660-9ad8feaa09a9-kube-api-access-f6cwg\") pod \"network-check-source-6f78d59f99-d2vr7\" (UID: \"95661150-16a9-4b3a-9660-9ad8feaa09a9\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-d2vr7"
Oct 30 06:56:38.580247 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.580231    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vdm\" (UniqueName: \"kubernetes.io/projected/a733e34a-1603-4bd5-8ef0-5ff872027fa6-kube-api-access-r9vdm\") pod \"volume-data-source-validator-58c9f5f46d-hk42v\" (UID: \"a733e34a-1603-4bd5-8ef0-5ff872027fa6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-hk42v"
Oct 30 06:56:38.580406 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.580385    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47gx5\" (UniqueName: \"kubernetes.io/projected/334689c1-93d2-4b74-8d46-20890f606782-kube-api-access-47gx5\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.585743 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.585725    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") pod \"periodic-gathering-v9xr8-jmxsw\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") " pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:56:38.589424 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.589395    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9xb\" (UniqueName: \"kubernetes.io/projected/e2d9f695-6bb2-433a-862a-3e626fedbe8e-kube-api-access-nz9xb\") pod \"service-ca-5fffc97bdf-ft8fb\" (UID: \"e2d9f695-6bb2-433a-862a-3e626fedbe8e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-ft8fb"
Oct 30 06:56:38.589610 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.589592    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlgf\" (UniqueName: \"kubernetes.io/projected/609ce248-2b9f-4fc1-b23a-b075ca520a3e-kube-api-access-jmlgf\") pod \"migrator-66df5d496b-8tgr6\" (UID: \"609ce248-2b9f-4fc1-b23a-b075ca520a3e\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-8tgr6"
Oct 30 06:56:38.589690 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.589672    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfg2\" (UniqueName: \"kubernetes.io/projected/5d01ad1b-d546-48f6-b5b8-980de74eb623-kube-api-access-lrfg2\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.589738 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.589706    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqk66\" (UniqueName: \"kubernetes.io/projected/9e54b74c-ba81-405b-9002-c7ff8719e93d-kube-api-access-dqk66\") pod \"kas-connection-checker-685895c7c9-rns6c\" (UID: \"9e54b74c-ba81-405b-9002-c7ff8719e93d\") " pod="kube-system/kas-connection-checker-685895c7c9-rns6c"
Oct 30 06:56:38.589970 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.589952    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhntt\" (UniqueName: \"kubernetes.io/projected/10492054-f044-4bee-93c4-e316fc500bff-kube-api-access-zhntt\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.590840 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.590816    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6r4j\" (UniqueName: \"kubernetes.io/projected/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kube-api-access-b6r4j\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.590977 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.590960    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.591042 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.591014    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbp6\" (UniqueName: \"kubernetes.io/projected/46375128-278b-46e4-ace2-13374ad65d23-kube-api-access-2kbp6\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.591381 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.591363    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.593743 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.593723    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgp67\" (UniqueName: \"kubernetes.io/projected/dae48309-e15e-4919-a6d3-051758b7a23e-kube-api-access-tgp67\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.594225 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.594207    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.594302 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.594280    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chrf4\" (UniqueName: \"kubernetes.io/projected/3a361442-634d-4ff5-990a-29095aa6264d-kube-api-access-chrf4\") pod \"ingress-canary-xghrm\" (UID: \"3a361442-634d-4ff5-990a-29095aa6264d\") " pod="openshift-ingress-canary/ingress-canary-xghrm"
Oct 30 06:56:38.594495 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.594475    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx76m\" (UniqueName: \"kubernetes.io/projected/497c3d29-4ad7-4314-b73a-8015ea05057f-kube-api-access-mx76m\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:38.594574 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.594557    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5g9l\" (UniqueName: \"kubernetes.io/projected/e34614b0-e9e0-48fa-ae70-99404431cc66-kube-api-access-z5g9l\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.594619 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.594574    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgsds\" (UniqueName: \"kubernetes.io/projected/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-api-access-sgsds\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.594996 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.594981    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vf7\" (UniqueName: \"kubernetes.io/projected/7c4c7ef9-3135-44ee-afd2-f49226ff7ba9-kube-api-access-h8vf7\") pod \"console-operator-7cd56b8dbc-m59nb\" (UID: \"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:38.595205 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.595191    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chsqg\" (UniqueName: \"kubernetes.io/projected/96156c02-8e1f-4612-b919-b20007fe0dda-kube-api-access-chsqg\") pod \"insights-operator-7c4986d449-95gsq\" (UID: \"96156c02-8e1f-4612-b919-b20007fe0dda\") " pod="openshift-insights/insights-operator-7c4986d449-95gsq"
Oct 30 06:56:38.596397 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.596377    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps8pz\" (UniqueName: \"kubernetes.io/projected/bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b-kube-api-access-ps8pz\") pod \"network-check-target-jlk9l\" (UID: \"bc0cd3c6-5347-47ef-b81e-6a6c0d5def3b\") " pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:38.600268 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.600251    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfcl\" (UniqueName: \"kubernetes.io/projected/f1c149b5-13ba-423f-a970-98da3c328798-kube-api-access-pvfcl\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.653868 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653792    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.653868 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653824    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysconfig\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653845    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-kubernetes\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653890    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-dbus\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653911    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-etc-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653925    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysconfig\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653934    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653926    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653964    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-kubernetes\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653964    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-etc-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.654002 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653991    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-dbus\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653985    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.653995    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654047    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-hostroot\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654072    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654094    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-kubelet\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654115    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/580c167c-2e1f-4dbd-86b2-4412e856f1c2-host-slash\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654123    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-hostroot\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654150    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-system-cni-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654171    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-kubelet\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654176    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-socket-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654198    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-bin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654208    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/580c167c-2e1f-4dbd-86b2-4412e856f1c2-host-slash\") pod \"iptables-alerter-p6pb4\" (UID: \"580c167c-2e1f-4dbd-86b2-4412e856f1c2\") " pod="openshift-network-operator/iptables-alerter-p6pb4"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654216    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654224    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-system-cni-dir\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654237    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-conf\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654256    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-socket-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654267    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-netns\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654288    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-netns\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654238    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-bin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654293    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-systemd-units\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654323    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-multus\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654327    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-systemd-units\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654340    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-sys-fs\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654345    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-sysctl-conf\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654369    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.654369 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654381    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-sys-fs\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654387    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-var-lib-cni-multus\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654398    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-kubelet-config\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654426    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654452    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-registration-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654457    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51d62594-4baa-4505-9f8a-ab165b3b1ba0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654461    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654473    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae48309-e15e-4919-a6d3-051758b7a23e-host\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654495    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cnibin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654508    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae48309-e15e-4919-a6d3-051758b7a23e-host\") pod \"node-ca-fnh8d\" (UID: \"dae48309-e15e-4919-a6d3-051758b7a23e\") " pod="openshift-image-registry/node-ca-fnh8d"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654511    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-registration-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654470    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a45a4f45-8253-4317-82ca-9edf34f33dbd-kubelet-config\") pod \"global-pull-secret-syncer-mvld4\" (UID: \"a45a4f45-8253-4317-82ca-9edf34f33dbd\") " pod="kube-system/global-pull-secret-syncer-mvld4"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654520    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654555    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-cnibin\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654553    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-systemd\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654580    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-sys\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654592    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-systemd\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654602    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-cnibin\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654594    5073 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654630    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-sys\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654633    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46375128-278b-46e4-ace2-13374ad65d23-cnibin\") pod \"multus-additional-cni-plugins-qn9r5\" (UID: \"46375128-278b-46e4-ace2-13374ad65d23\") " pod="openshift-multus/multus-additional-cni-plugins-qn9r5"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654632    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654665    5073 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654676    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-var-lib-kubelet\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654687    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.154670766 +0000 UTC m=+1.862550917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654710    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-netd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654716    5073 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654733    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654715    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-var-lib-kubelet\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654761    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls podName:e34614b0-e9e0-48fa-ae70-99404431cc66 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.15475095 +0000 UTC m=+1.862631100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4gvn9" (UID: "e34614b0-e9e0-48fa-ae70-99404431cc66") : secret "samples-operator-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654758    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-netd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654781    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-modprobe-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654803    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-host\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654807    5073 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654819    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654841    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.154829713 +0000 UTC m=+1.862709873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : secret "metrics-daemon-secret" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654894    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51d62594-4baa-4505-9f8a-ab165b3b1ba0-crio-socket\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654907    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654914    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-host\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654919    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654934    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-etc-modprobe-d\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654952    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654967    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51d62594-4baa-4505-9f8a-ab165b3b1ba0-crio-socket\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.654924    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.654986    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.154971636 +0000 UTC m=+1.862851800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655023    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-system-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655045    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-system-cni-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655046    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-systemd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655074    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655099    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-systemd\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655100    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655144    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-socket-dir-parent\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.655163    5073 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655174    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-etc-kubernetes\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655187    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-socket-dir-parent\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655162    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.655201    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.155189048 +0000 UTC m=+1.863069195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655217    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-ovn\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655237    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-log-socket\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655238    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-run-ovn\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655251    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655219    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-etc-kubernetes\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655271    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-device-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655289    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-log-socket\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655295    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-bin\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655308    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655319    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655334    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-device-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655343    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-k8s-cni-cncf-io\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.655319 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655344    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-cni-bin\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655374    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-k8s-cni-cncf-io\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655366    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-conf-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655394    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-multus-conf-dir\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.655405    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655408    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-slash\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.655416    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655426    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-kubelet\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655442    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:38.655456    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:39.155444521 +0000 UTC m=+1.863324711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655472    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-kubelet\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655474    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-slash\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655479    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-var-lib-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655503    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-var-lib-openvswitch\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655504    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-node-log\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655524    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-run\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655524    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-node-log\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655540    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-netns\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655569    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c149b5-13ba-423f-a970-98da3c328798-host-run-netns\") pod \"ovnkube-node-zm7qp\" (UID: \"f1c149b5-13ba-423f-a970-98da3c328798\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655570    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-run\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655580    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655602    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-multus-certs\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655619    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655634    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/334689c1-93d2-4b74-8d46-20890f606782-hosts-file\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655655    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04664ebb-d94a-4bfe-a346-b441a7da0e3f-host-run-multus-certs\") pod \"multus-2snxl\" (UID: \"04664ebb-d94a-4bfe-a346-b441a7da0e3f\") " pod="openshift-multus/multus-2snxl"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655656    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-lib-modules\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655678    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe045d03-9b1b-4d8c-bc20-bc50f21a60e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-np27j\" (UID: \"fe045d03-9b1b-4d8c-bc20-bc50f21a60e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-np27j"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655683    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655719    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f38e4bfa-c76a-459a-b0c2-2f731ca919fc-lib-modules\") pod \"tuned-hvtgp\" (UID: \"f38e4bfa-c76a-459a-b0c2-2f731ca919fc\") " pod="openshift-cluster-node-tuning-operator/tuned-hvtgp"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.655752    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/334689c1-93d2-4b74-8d46-20890f606782-hosts-file\") pod \"node-resolver-kg9qk\" (UID: \"334689c1-93d2-4b74-8d46-20890f606782\") " pod="openshift-dns/node-resolver-kg9qk"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.656226    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d01ad1b-d546-48f6-b5b8-980de74eb623-service-ca-bundle\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.657161    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/df38da75-f716-4dd4-a6eb-f736d0d2ac6c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-88z7x\" (UID: \"df38da75-f716-4dd4-a6eb-f736d0d2ac6c\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.658159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.657770    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acb49735-f2be-44e2-92f2-65f68a386864-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-b7r65\" (UID: \"acb49735-f2be-44e2-92f2-65f68a386864\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:38.659034 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.658234    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d01ad1b-d546-48f6-b5b8-980de74eb623-metrics-certs\") pod \"router-default-789654ff5-xkswj\" (UID: \"5d01ad1b-d546-48f6-b5b8-980de74eb623\") " pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.727132 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.727111    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:38.727233 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.727147    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"
Oct 30 06:56:38.728509 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.728493    5073 scope.go:122] "RemoveContainer" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef"
Oct 30 06:56:38.729844 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:38.729824    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65"
Oct 30 06:56:39.055911 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.055886    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-b7r65"]
Oct 30 06:56:39.057845 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:39.057808    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb49735_f2be_44e2_92f2_65f68a386864.slice/crio-63e5ff9750f04f3ff3deaaf585a4d48d860fb41127547a2bc77cf185a4137e15 WatchSource:0}: Error finding container 63e5ff9750f04f3ff3deaaf585a4d48d860fb41127547a2bc77cf185a4137e15: Status 404 returned error can't find the container with id 63e5ff9750f04f3ff3deaaf585a4d48d860fb41127547a2bc77cf185a4137e15
Oct 30 06:56:39.059909 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.059892    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 06:56:39.070726 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.070707    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x"]
Oct 30 06:56:39.072394 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:39.072361    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf38da75_f716_4dd4_a6eb_f736d0d2ac6c.slice/crio-605a3f3ee48a7edb981cc9f8556e0c63908a65ebf340780c77749ddb05a6454e WatchSource:0}: Error finding container 605a3f3ee48a7edb981cc9f8556e0c63908a65ebf340780c77749ddb05a6454e: Status 404 returned error can't find the container with id 605a3f3ee48a7edb981cc9f8556e0c63908a65ebf340780c77749ddb05a6454e
Oct 30 06:56:39.074070 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.074016    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-789654ff5-xkswj"]
Oct 30 06:56:39.084155 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:39.084132    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d01ad1b_d546_48f6_b5b8_980de74eb623.slice/crio-5cf375630a41d4ac9eb5cd479bd147f53f3d93be1f8220194b2d90ebfdd54206 WatchSource:0}: Error finding container 5cf375630a41d4ac9eb5cd479bd147f53f3d93be1f8220194b2d90ebfdd54206: Status 404 returned error can't find the container with id 5cf375630a41d4ac9eb5cd479bd147f53f3d93be1f8220194b2d90ebfdd54206
Oct 30 06:56:39.160156 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.160126    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:39.160293 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.160172    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:39.160293 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.160202    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:39.160293 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.160228    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:39.160293 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160259    5073 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160309    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:40.160296085 +0000 UTC m=+2.868176263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160344    5073 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160394    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:40.160380502 +0000 UTC m=+2.868260656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160455    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160464    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160493    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:40.160483964 +0000 UTC m=+2.868364119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:39.160529 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.160261    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:39.160873 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.160539    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:39.160873 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160673    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:39.160873 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160682    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:39.160873 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160709    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:40.160700421 +0000 UTC m=+2.868580570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:39.160873 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160824    5073 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 06:56:39.161064 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.160912    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs podName:497c3d29-4ad7-4314-b73a-8015ea05057f nodeName:}" failed. No retries permitted until 2026-10-30 06:56:40.160896211 +0000 UTC m=+2.868776371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs") pod "network-metrics-daemon-76th7" (UID: "497c3d29-4ad7-4314-b73a-8015ea05057f") : secret "metrics-daemon-secret" not found
Oct 30 06:56:39.162900 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.162876    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e34614b0-e9e0-48fa-ae70-99404431cc66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4gvn9\" (UID: \"e34614b0-e9e0-48fa-ae70-99404431cc66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:39.329666 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.329590    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"
Oct 30 06:56:39.487333 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.487293    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x" event={"ID":"df38da75-f716-4dd4-a6eb-f736d0d2ac6c","Type":"ContainerStarted","Data":"605a3f3ee48a7edb981cc9f8556e0c63908a65ebf340780c77749ddb05a6454e"}
Oct 30 06:56:39.489070 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.489048    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 06:56:39.489514 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.489497    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/1.log"
Oct 30 06:56:39.489607 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.489536    5073 generic.go:356] "Generic (PLEG): container finished" podID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" containerID="58a52506a3f0ed5aac8a40470823141377a4bce05fd484b8d372faf72ee2a198" exitCode=255
Oct 30 06:56:39.489660 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.489609    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" event={"ID":"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9","Type":"ContainerDied","Data":"58a52506a3f0ed5aac8a40470823141377a4bce05fd484b8d372faf72ee2a198"}
Oct 30 06:56:39.489707 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.489666    5073 scope.go:122] "RemoveContainer" containerID="9cfbaea5966de518579266bf435943a9da48a428b28accfea0feb2222c75abef"
Oct 30 06:56:39.490072 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.490052    5073 scope.go:122] "RemoveContainer" containerID="58a52506a3f0ed5aac8a40470823141377a4bce05fd484b8d372faf72ee2a198"
Oct 30 06:56:39.490297 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:39.490276    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-m59nb_openshift-console-operator(7c4c7ef9-3135-44ee-afd2-f49226ff7ba9)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9"
Oct 30 06:56:39.491149 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.491110    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65" event={"ID":"acb49735-f2be-44e2-92f2-65f68a386864","Type":"ContainerStarted","Data":"63e5ff9750f04f3ff3deaaf585a4d48d860fb41127547a2bc77cf185a4137e15"}
Oct 30 06:56:39.492764 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.492742    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-789654ff5-xkswj" event={"ID":"5d01ad1b-d546-48f6-b5b8-980de74eb623","Type":"ContainerStarted","Data":"0e2c7f3113ea410a281201323187193cf806afa98447d0a556993838f3e7ff51"}
Oct 30 06:56:39.492872 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.492783    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-789654ff5-xkswj" event={"ID":"5d01ad1b-d546-48f6-b5b8-980de74eb623","Type":"ContainerStarted","Data":"5cf375630a41d4ac9eb5cd479bd147f53f3d93be1f8220194b2d90ebfdd54206"}
Oct 30 06:56:39.630905 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.630796    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9"]
Oct 30 06:56:39.727400 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.727366    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:39.729992 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:39.729961    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:40.172787 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.172752    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:40.172954 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.172802    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:40.172954 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.172830    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:40.172954 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.172864    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:40.172954 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.172889    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:40.173201 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173008    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:40.173201 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173019    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:40.173201 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173068    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:42.17305067 +0000 UTC m=+4.880930820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:40.173448 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173430    5073 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:40.173499 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173473    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:42.173463081 +0000 UTC m=+4.881343227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:40.173871 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173833    5073 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:40.173988 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173898    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:42.173883256 +0000 UTC m=+4.881763418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:40.173988 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173961    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:40.173988 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.173981    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:40.174165 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:40.174035    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:42.174018669 +0000 UTC m=+4.881898822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:40.176161 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.176136    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/497c3d29-4ad7-4314-b73a-8015ea05057f-metrics-certs\") pod \"network-metrics-daemon-76th7\" (UID: \"497c3d29-4ad7-4314-b73a-8015ea05057f\") " pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:40.234227 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.234201    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-76th7"
Oct 30 06:56:40.499227 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.499187    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-b7r65" event={"ID":"acb49735-f2be-44e2-92f2-65f68a386864","Type":"ContainerStarted","Data":"f36851e139f43524f23162c76c1ab826816a541785ffbfab3ceb1a1d246d37c6"}
Oct 30 06:56:40.500741 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.500708    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9" event={"ID":"e34614b0-e9e0-48fa-ae70-99404431cc66","Type":"ContainerStarted","Data":"1e72286a528d6d1e63d66248fc3bd4c374e4d8c3648bdcd3643f9e8f6f734f2e"}
Oct 30 06:56:40.502975 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.502957    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 06:56:40.541396 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:40.541364    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-76th7"]
Oct 30 06:56:40.550055 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:40.550025    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497c3d29_4ad7_4314_b73a_8015ea05057f.slice/crio-aa234616bfe5088725f95038d1bb83d6644d9511bdc8b5f8b4025393dcaff2a7 WatchSource:0}: Error finding container aa234616bfe5088725f95038d1bb83d6644d9511bdc8b5f8b4025393dcaff2a7: Status 404 returned error can't find the container with id aa234616bfe5088725f95038d1bb83d6644d9511bdc8b5f8b4025393dcaff2a7
Oct 30 06:56:41.508056 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:41.508024    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-88z7x" event={"ID":"df38da75-f716-4dd4-a6eb-f736d0d2ac6c","Type":"ContainerStarted","Data":"e2f703da223628d87e12c6b0b453776acbdfb32d56a04e921564d12fe6f0128a"}
Oct 30 06:56:41.509261 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:41.509236    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76th7" event={"ID":"497c3d29-4ad7-4314-b73a-8015ea05057f","Type":"ContainerStarted","Data":"aa234616bfe5088725f95038d1bb83d6644d9511bdc8b5f8b4025393dcaff2a7"}
Oct 30 06:56:41.509261 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:41.509250    5073 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 06:56:41.720703 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:41.720672    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:42.192839 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.192801    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:42.192980 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.192871    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:42.192980 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.192908    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:42.192980 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.192947    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:42.192980 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.192972    5073 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 06:56:42.193118 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193034    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls podName:10492054-f044-4bee-93c4-e316fc500bff nodeName:}" failed. No retries permitted until 2026-10-30 06:56:46.193017169 +0000 UTC m=+8.900897330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls") pod "dns-default-l6xts" (UID: "10492054-f044-4bee-93c4-e316fc500bff") : secret "dns-default-metrics-tls" not found
Oct 30 06:56:42.193118 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193053    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:42.193118 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193064    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b74f6655f-cf7cw: secret "image-registry-tls" not found
Oct 30 06:56:42.193118 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193096    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls podName:7b33b614-d743-45a3-a9e0-117db6e23f6e nodeName:}" failed. No retries permitted until 2026-10-30 06:56:46.193085685 +0000 UTC m=+8.900965832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls") pod "image-registry-6b74f6655f-cf7cw" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e") : secret "image-registry-tls" not found
Oct 30 06:56:42.193118 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193053    5073 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:42.193287 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193096    5073 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 06:56:42.193287 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193177    5073 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b55fb966-6lrtj: secret "image-registry-tls" not found
Oct 30 06:56:42.193287 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193156    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls podName:51d62594-4baa-4505-9f8a-ab165b3b1ba0 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:46.193142743 +0000 UTC m=+8.901022895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9vw6" (UID: "51d62594-4baa-4505-9f8a-ab165b3b1ba0") : secret "insights-runtime-extractor-tls" not found
Oct 30 06:56:42.193287 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:42.193230    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls podName:a47ad62b-dd57-4c62-bc04-c688238cbe85 nodeName:}" failed. No retries permitted until 2026-10-30 06:56:46.193214717 +0000 UTC m=+8.901094879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls") pod "image-registry-8b55fb966-6lrtj" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85") : secret "image-registry-tls" not found
Oct 30 06:56:42.515212 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.515180    5073 generic.go:356] "Generic (PLEG): container finished" podID="96156c02-8e1f-4612-b919-b20007fe0dda" containerID="c27695e7ef975fb9614eb2c35f2b1d1c43d8dd622e0d88d8083bbb182ac8aed3" exitCode=0
Oct 30 06:56:42.515660 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.515257    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-95gsq" event={"ID":"96156c02-8e1f-4612-b919-b20007fe0dda","Type":"ContainerDied","Data":"c27695e7ef975fb9614eb2c35f2b1d1c43d8dd622e0d88d8083bbb182ac8aed3"}
Oct 30 06:56:42.515725 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.515661    5073 scope.go:122] "RemoveContainer" containerID="c27695e7ef975fb9614eb2c35f2b1d1c43d8dd622e0d88d8083bbb182ac8aed3"
Oct 30 06:56:42.517310 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.517275    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9" event={"ID":"e34614b0-e9e0-48fa-ae70-99404431cc66","Type":"ContainerStarted","Data":"41ee5f046e424748e564e6d42159d12d6bf643522f7f645ee830fafca50f38f8"}
Oct 30 06:56:42.517399 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.517336    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4gvn9" event={"ID":"e34614b0-e9e0-48fa-ae70-99404431cc66","Type":"ContainerStarted","Data":"bd3eec99d1d34a2a38090421b23d4243aa4b928fa8543d7501200c40248abb60"}
Oct 30 06:56:42.519245 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.519212    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76th7" event={"ID":"497c3d29-4ad7-4314-b73a-8015ea05057f","Type":"ContainerStarted","Data":"9108a8b2a4fef3bd306111bbb151eff5e1d4bd10bff70a2da06764b9f25bf65f"}
Oct 30 06:56:42.519353 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.519261    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-76th7" event={"ID":"497c3d29-4ad7-4314-b73a-8015ea05057f","Type":"ContainerStarted","Data":"43fbe8d082866bfa42fcd818c6db626f239151e2e9d711ce124bb6fea20d5f77"}
Oct 30 06:56:42.520640 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.520619    5073 generic.go:356] "Generic (PLEG): container finished" podID="88abcbca-0455-472c-ab5a-6bd2a50d4544" containerID="2711a97697a290c394d12f5548df5356216aefd1e776036376f4e28479a03fc4" exitCode=0
Oct 30 06:56:42.520740 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.520691    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh" event={"ID":"88abcbca-0455-472c-ab5a-6bd2a50d4544","Type":"ContainerDied","Data":"2711a97697a290c394d12f5548df5356216aefd1e776036376f4e28479a03fc4"}
Oct 30 06:56:42.520991 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.520975    5073 scope.go:122] "RemoveContainer" containerID="2711a97697a290c394d12f5548df5356216aefd1e776036376f4e28479a03fc4"
Oct 30 06:56:42.522273 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.522252    5073 generic.go:356] "Generic (PLEG): container finished" podID="f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792" containerID="898ee2ee050b4b09da62e36d09d36c57e831c7f31138eb71e46d55334a7bb01d" exitCode=0
Oct 30 06:56:42.522345 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.522321    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb" event={"ID":"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792","Type":"ContainerDied","Data":"898ee2ee050b4b09da62e36d09d36c57e831c7f31138eb71e46d55334a7bb01d"}
Oct 30 06:56:42.522706 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.522688    5073 scope.go:122] "RemoveContainer" containerID="898ee2ee050b4b09da62e36d09d36c57e831c7f31138eb71e46d55334a7bb01d"
Oct 30 06:56:42.544689 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.544671    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:42.544845 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:42.544833    5073 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 06:56:43.528241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:43.528207    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-89rrh" event={"ID":"88abcbca-0455-472c-ab5a-6bd2a50d4544","Type":"ContainerStarted","Data":"a8ccdc30a3be90e8d23151a7c965447781ed1b3340b9bd485594e9c8c8f9db65"}
Oct 30 06:56:43.530061 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:43.530036    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tkvbb" event={"ID":"f35e8a6f-7d8c-4a23-a8c3-8f6a0817d792","Type":"ContainerStarted","Data":"df24f6be77c5a7f578dc03da9ada094ebc79fec1c1284362f6f42732ec2754da"}
Oct 30 06:56:43.531879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:43.531832    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-95gsq" event={"ID":"96156c02-8e1f-4612-b919-b20007fe0dda","Type":"ContainerStarted","Data":"e835c4898be94c8113f9424f05aec04321bec5ca6eb971b75970cc923ab93d27"}
Oct 30 06:56:45.066146 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:45.066106    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:45.066519 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:45.066470    5073 scope.go:122] "RemoveContainer" containerID="58a52506a3f0ed5aac8a40470823141377a4bce05fd484b8d372faf72ee2a198"
Oct 30 06:56:45.066656 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:45.066638    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-m59nb_openshift-console-operator(7c4c7ef9-3135-44ee-afd2-f49226ff7ba9)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9"
Oct 30 06:56:45.789330 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:45.789288    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:45.789541 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:45.789448    5073 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 06:56:45.790739 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:45.790719    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-789654ff5-xkswj"
Oct 30 06:56:46.234151 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.234116    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:46.234518 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.234161    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:46.234518 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.234186    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:46.234518 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.234214    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:46.236671 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.236643    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10492054-f044-4bee-93c4-e316fc500bff-metrics-tls\") pod \"dns-default-l6xts\" (UID: \"10492054-f044-4bee-93c4-e316fc500bff\") " pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:46.236778 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.236667    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51d62594-4baa-4505-9f8a-ab165b3b1ba0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9vw6\" (UID: \"51d62594-4baa-4505-9f8a-ab165b3b1ba0\") " pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:46.236815 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.236778    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"image-registry-6b74f6655f-cf7cw\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") " pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:46.236886 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.236842    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"image-registry-8b55fb966-6lrtj\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") " pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:46.238631 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.238611    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9vw6"
Oct 30 06:56:46.527355 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.527285    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:46.535607 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.535578    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:46.535935 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.535687    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:46.537511 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.537439    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w9vw6"]
Oct 30 06:56:46.540824 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:46.540651    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d62594_4baa_4505_9f8a_ab165b3b1ba0.slice/crio-b0929533d3afb1f93c1c2b6f596c8ed1ac448e66ecea10fe7afb9afc8e6660f7 WatchSource:0}: Error finding container b0929533d3afb1f93c1c2b6f596c8ed1ac448e66ecea10fe7afb9afc8e6660f7: Status 404 returned error can't find the container with id b0929533d3afb1f93c1c2b6f596c8ed1ac448e66ecea10fe7afb9afc8e6660f7
Oct 30 06:56:46.562166 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.562069    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:56:46.838802 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.838774    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8b55fb966-6lrtj"]
Oct 30 06:56:46.840611 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:46.840582    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47ad62b_dd57_4c62_bc04_c688238cbe85.slice/crio-1a60375443e787d65a12335b9b6435fe4f46fe02d3fc022e7105f56f4a8b6410 WatchSource:0}: Error finding container 1a60375443e787d65a12335b9b6435fe4f46fe02d3fc022e7105f56f4a8b6410: Status 404 returned error can't find the container with id 1a60375443e787d65a12335b9b6435fe4f46fe02d3fc022e7105f56f4a8b6410
Oct 30 06:56:46.856362 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.856335    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b74f6655f-cf7cw"]
Oct 30 06:56:46.857478 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:46.857454    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b33b614_d743_45a3_a9e0_117db6e23f6e.slice/crio-1e56abc7e2693c389cfab25672ff92f5bd344644de8f801ea1d72b394385ab7f WatchSource:0}: Error finding container 1e56abc7e2693c389cfab25672ff92f5bd344644de8f801ea1d72b394385ab7f: Status 404 returned error can't find the container with id 1e56abc7e2693c389cfab25672ff92f5bd344644de8f801ea1d72b394385ab7f
Oct 30 06:56:46.864248 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:46.864225    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6xts"]
Oct 30 06:56:46.866789 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:46.866767    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10492054_f044_4bee_93c4_e316fc500bff.slice/crio-5c5a9f2db07b00cb39c1908fe9e491c78bc67c457a8474b2fd465e92685d4271 WatchSource:0}: Error finding container 5c5a9f2db07b00cb39c1908fe9e491c78bc67c457a8474b2fd465e92685d4271: Status 404 returned error can't find the container with id 5c5a9f2db07b00cb39c1908fe9e491c78bc67c457a8474b2fd465e92685d4271
Oct 30 06:56:47.164311 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.164278    5073 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:47.164820 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.164803    5073 scope.go:122] "RemoveContainer" containerID="58a52506a3f0ed5aac8a40470823141377a4bce05fd484b8d372faf72ee2a198"
Oct 30 06:56:47.165101 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:56:47.165075    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-m59nb_openshift-console-operator(7c4c7ef9-3135-44ee-afd2-f49226ff7ba9)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9"
Oct 30 06:56:47.548627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.548535    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj" event={"ID":"a47ad62b-dd57-4c62-bc04-c688238cbe85","Type":"ContainerStarted","Data":"54ba1d9e59cc10b5e35b63e3eeb78e11b34ee3dd7b29ba25579d8d816a90bc45"}
Oct 30 06:56:47.549087 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.548640    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:56:47.549087 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.548662    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj" event={"ID":"a47ad62b-dd57-4c62-bc04-c688238cbe85","Type":"ContainerStarted","Data":"1a60375443e787d65a12335b9b6435fe4f46fe02d3fc022e7105f56f4a8b6410"}
Oct 30 06:56:47.551268 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.551241    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9vw6" event={"ID":"51d62594-4baa-4505-9f8a-ab165b3b1ba0","Type":"ContainerStarted","Data":"9d9b7ec38af3f1d7fbe9353b96d976cc8ef854d5f367ff118618a1f8db854714"}
Oct 30 06:56:47.551388 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.551298    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9vw6" event={"ID":"51d62594-4baa-4505-9f8a-ab165b3b1ba0","Type":"ContainerStarted","Data":"3cd4168f21e04526e9d618a975aafa08eed6664daba3172a92b6137839a6a778"}
Oct 30 06:56:47.551388 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.551324    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9vw6" event={"ID":"51d62594-4baa-4505-9f8a-ab165b3b1ba0","Type":"ContainerStarted","Data":"b0929533d3afb1f93c1c2b6f596c8ed1ac448e66ecea10fe7afb9afc8e6660f7"}
Oct 30 06:56:47.553279 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.553253    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" event={"ID":"7b33b614-d743-45a3-a9e0-117db6e23f6e","Type":"ContainerStarted","Data":"ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03"}
Oct 30 06:56:47.553374 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.553298    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" event={"ID":"7b33b614-d743-45a3-a9e0-117db6e23f6e","Type":"ContainerStarted","Data":"1e56abc7e2693c389cfab25672ff92f5bd344644de8f801ea1d72b394385ab7f"}
Oct 30 06:56:47.554613 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:47.554553    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6xts" event={"ID":"10492054-f044-4bee-93c4-e316fc500bff","Type":"ContainerStarted","Data":"5c5a9f2db07b00cb39c1908fe9e491c78bc67c457a8474b2fd465e92685d4271"}
Oct 30 06:56:48.372632 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:48.372601    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm7qp"
Oct 30 06:56:48.557997 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:48.557974    5073 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 06:56:49.414416 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.414382    5073 scope.go:122] "RemoveContainer" containerID="58a52506a3f0ed5aac8a40470823141377a4bce05fd484b8d372faf72ee2a198"
Oct 30 06:56:49.564799 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.564756    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9vw6" event={"ID":"51d62594-4baa-4505-9f8a-ab165b3b1ba0","Type":"ContainerStarted","Data":"08efccf17675a02e39dc5dc999d0985ffed583cd2935c9229d571fcb0602bc98"}
Oct 30 06:56:49.566517 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.566497    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 06:56:49.566624 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.566577    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" event={"ID":"7c4c7ef9-3135-44ee-afd2-f49226ff7ba9","Type":"ContainerStarted","Data":"10aa903d51fb3aa0b3bd874ab4ce42e1f52a580b0993c106e5591ba3f70673e0"}
Oct 30 06:56:49.566870 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.566830    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:49.567886 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.567838    5073 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-m59nb container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/readyz\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Oct 30 06:56:49.567975 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.567947    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb" podUID="7c4c7ef9-3135-44ee-afd2-f49226ff7ba9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.21:8443/readyz\": dial tcp 10.132.0.21:8443: connect: connection refused"
Oct 30 06:56:49.568395 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.568368    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6xts" event={"ID":"10492054-f044-4bee-93c4-e316fc500bff","Type":"ContainerStarted","Data":"8f17abc8222fe22e764e04e753ae000b24e6d1124e938aa35f06ca54876317c4"}
Oct 30 06:56:49.568466 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.568411    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6xts" event={"ID":"10492054-f044-4bee-93c4-e316fc500bff","Type":"ContainerStarted","Data":"17a731d4133e41a5a801aa3c1fafb7986a63cd9350a6c1a4ea9a928d2eed73fb"}
Oct 30 06:56:49.568527 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:49.568515    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l6xts"
Oct 30 06:56:50.576252 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:50.576225    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-m59nb"
Oct 30 06:56:51.501717 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:51.501669    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:56:52.358193 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.358158    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-tfhwn-wrv42"]
Oct 30 06:56:52.363372 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.363349    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.386949 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.386250    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.386949 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.386318    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzxm\" (UniqueName: \"kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.386949 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.386376    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.386949 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.386430    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.391105 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.391074    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-tfhwn-wrv42"]
Oct 30 06:56:52.414769 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.414737    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"]
Oct 30 06:56:52.418784 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.418758    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:52.424162 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.424136    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-nkjdj"]
Oct 30 06:56:52.428276 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.428254    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.436008 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.435984    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8b55fb966-6lrtj"]
Oct 30 06:56:52.447913 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.447877    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"]
Oct 30 06:56:52.448241 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.448200    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vp4md\""
Oct 30 06:56:52.448413 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.448327    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 06:56:52.453497 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.453479    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 06:56:52.453739 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.453725    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 06:56:52.462277 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.462245    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-nkjdj"]
Oct 30 06:56:52.487318 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487292    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.487450 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487331    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chsc8\" (UniqueName: \"kubernetes.io/projected/7b6d3dbf-ff16-483c-9025-4198dede4828-kube-api-access-chsc8\") pod \"downloads-6dd789c8b7-nkjdj\" (UID: \"7b6d3dbf-ff16-483c-9025-4198dede4828\") " pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.487540 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487462    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6d3dbf-ff16-483c-9025-4198dede4828-tmp\") pod \"downloads-6dd789c8b7-nkjdj\" (UID: \"7b6d3dbf-ff16-483c-9025-4198dede4828\") " pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.487540 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487501    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzxm\" (UniqueName: \"kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.487721 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487552    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.487721 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487589    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.487721 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487610    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cd4caed-1edf-464d-9f67-9156311d271a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-vgnfg\" (UID: \"8cd4caed-1edf-464d-9f67-9156311d271a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:52.488122 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.487729    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.488394 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.488374    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.488476 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.488459    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.531583 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.531550    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6454486969-lf5r4"]
Oct 30 06:56:52.532714 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.532684    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzxm\" (UniqueName: \"kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm\") pod \"periodic-gathering-tfhwn-wrv42\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") " pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.535888 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.535866    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.543883 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.543839    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-gmwst\""
Oct 30 06:56:52.557206 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.557181    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6454486969-lf5r4"]
Oct 30 06:56:52.588739 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.588709    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35bdd859-dc65-4dcc-b645-5859ea4ce046-ca-trust-extracted\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.588935 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.588746    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvg76\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-kube-api-access-lvg76\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.588935 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.588768    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35bdd859-dc65-4dcc-b645-5859ea4ce046-trusted-ca\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.588935 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.588884    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35bdd859-dc65-4dcc-b645-5859ea4ce046-image-registry-private-configuration\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.588935 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.588922    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cd4caed-1edf-464d-9f67-9156311d271a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-vgnfg\" (UID: \"8cd4caed-1edf-464d-9f67-9156311d271a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:52.589110 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.588981    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-bound-sa-token\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.589110 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.589009    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35bdd859-dc65-4dcc-b645-5859ea4ce046-installation-pull-secrets\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.589110 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.589039    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chsc8\" (UniqueName: \"kubernetes.io/projected/7b6d3dbf-ff16-483c-9025-4198dede4828-kube-api-access-chsc8\") pod \"downloads-6dd789c8b7-nkjdj\" (UID: \"7b6d3dbf-ff16-483c-9025-4198dede4828\") " pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.589110 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.589105    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6d3dbf-ff16-483c-9025-4198dede4828-tmp\") pod \"downloads-6dd789c8b7-nkjdj\" (UID: \"7b6d3dbf-ff16-483c-9025-4198dede4828\") " pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.589303 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.589148    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-registry-tls\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.589303 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.589200    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35bdd859-dc65-4dcc-b645-5859ea4ce046-registry-certificates\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.589509 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.589491    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6d3dbf-ff16-483c-9025-4198dede4828-tmp\") pod \"downloads-6dd789c8b7-nkjdj\" (UID: \"7b6d3dbf-ff16-483c-9025-4198dede4828\") " pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.591308 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.591289    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cd4caed-1edf-464d-9f67-9156311d271a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-vgnfg\" (UID: \"8cd4caed-1edf-464d-9f67-9156311d271a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:52.612168 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.612102    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chsc8\" (UniqueName: \"kubernetes.io/projected/7b6d3dbf-ff16-483c-9025-4198dede4828-kube-api-access-chsc8\") pod \"downloads-6dd789c8b7-nkjdj\" (UID: \"7b6d3dbf-ff16-483c-9025-4198dede4828\") " pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.684013 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.683983    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:56:52.689833 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.689791    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-registry-tls\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.689983 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.689887    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35bdd859-dc65-4dcc-b645-5859ea4ce046-registry-certificates\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.689983 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.689915    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35bdd859-dc65-4dcc-b645-5859ea4ce046-ca-trust-extracted\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.689983 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.689951    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvg76\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-kube-api-access-lvg76\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.690168 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.689984    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35bdd859-dc65-4dcc-b645-5859ea4ce046-trusted-ca\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.690168 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.690012    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35bdd859-dc65-4dcc-b645-5859ea4ce046-image-registry-private-configuration\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.690168 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.690050    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-bound-sa-token\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.690168 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.690083    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35bdd859-dc65-4dcc-b645-5859ea4ce046-installation-pull-secrets\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.690431 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.690408    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35bdd859-dc65-4dcc-b645-5859ea4ce046-ca-trust-extracted\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.690964 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.690888    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35bdd859-dc65-4dcc-b645-5859ea4ce046-registry-certificates\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.691268 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.691243    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35bdd859-dc65-4dcc-b645-5859ea4ce046-trusted-ca\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.692967 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.692951    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-registry-tls\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.693254 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.693227    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35bdd859-dc65-4dcc-b645-5859ea4ce046-image-registry-private-configuration\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.693661 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.693641    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35bdd859-dc65-4dcc-b645-5859ea4ce046-installation-pull-secrets\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.714560 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.714534    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-bound-sa-token\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.715367 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.715348    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvg76\" (UniqueName: \"kubernetes.io/projected/35bdd859-dc65-4dcc-b645-5859ea4ce046-kube-api-access-lvg76\") pod \"image-registry-6454486969-lf5r4\" (UID: \"35bdd859-dc65-4dcc-b645-5859ea4ce046\") " pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:52.736558 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.736532    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:52.744618 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.744593    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:56:52.852124 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:52.851809    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:53.001731 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.001704    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-tfhwn-wrv42"]
Oct 30 06:56:53.003795 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:53.003767    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e5473d_07bf_411e_b2a6_b3ada28624eb.slice/crio-44d03fdae9861ee21e4482c7271a96df6ed42872b6f7977562e897e8d6e26b06 WatchSource:0}: Error finding container 44d03fdae9861ee21e4482c7271a96df6ed42872b6f7977562e897e8d6e26b06: Status 404 returned error can't find the container with id 44d03fdae9861ee21e4482c7271a96df6ed42872b6f7977562e897e8d6e26b06
Oct 30 06:56:53.095637 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.095607    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"]
Oct 30 06:56:53.096247 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:53.096214    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd4caed_1edf_464d_9f67_9156311d271a.slice/crio-0be14d2886967a936d81f4cf9b93c964c9efe3ccaf074c06ea21636724da52bf WatchSource:0}: Error finding container 0be14d2886967a936d81f4cf9b93c964c9efe3ccaf074c06ea21636724da52bf: Status 404 returned error can't find the container with id 0be14d2886967a936d81f4cf9b93c964c9efe3ccaf074c06ea21636724da52bf
Oct 30 06:56:53.098691 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.098669    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-nkjdj"]
Oct 30 06:56:53.100120 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:53.100079    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6d3dbf_ff16_483c_9025_4198dede4828.slice/crio-5f3e45865cce4600fc05d58f56153f1f9ac49732e9b3dfcf177ac45739deb930 WatchSource:0}: Error finding container 5f3e45865cce4600fc05d58f56153f1f9ac49732e9b3dfcf177ac45739deb930: Status 404 returned error can't find the container with id 5f3e45865cce4600fc05d58f56153f1f9ac49732e9b3dfcf177ac45739deb930
Oct 30 06:56:53.149712 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.149116    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-thvhj"
Oct 30 06:56:53.219057 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.218965    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6454486969-lf5r4"]
Oct 30 06:56:53.225563 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:56:53.225535    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bdd859_dc65_4dcc_b645_5859ea4ce046.slice/crio-efea7a7f35f8b2b05ca27c40a7785d7173c561d09105064fd1beedc1fb7c2037 WatchSource:0}: Error finding container efea7a7f35f8b2b05ca27c40a7785d7173c561d09105064fd1beedc1fb7c2037: Status 404 returned error can't find the container with id efea7a7f35f8b2b05ca27c40a7785d7173c561d09105064fd1beedc1fb7c2037
Oct 30 06:56:53.595819 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.595678    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-nkjdj" event={"ID":"7b6d3dbf-ff16-483c-9025-4198dede4828","Type":"ContainerStarted","Data":"5f3e45865cce4600fc05d58f56153f1f9ac49732e9b3dfcf177ac45739deb930"}
Oct 30 06:56:53.598536 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.598461    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg" event={"ID":"8cd4caed-1edf-464d-9f67-9156311d271a","Type":"ContainerStarted","Data":"0be14d2886967a936d81f4cf9b93c964c9efe3ccaf074c06ea21636724da52bf"}
Oct 30 06:56:53.601409 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.601378    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tfhwn-wrv42" event={"ID":"05e5473d-07bf-411e-b2a6-b3ada28624eb","Type":"ContainerStarted","Data":"9500734f224ac908212fa506a9a5cc831b96ce65149f0c092c62952507f5dae5"}
Oct 30 06:56:53.601530 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.601419    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tfhwn-wrv42" event={"ID":"05e5473d-07bf-411e-b2a6-b3ada28624eb","Type":"ContainerStarted","Data":"44d03fdae9861ee21e4482c7271a96df6ed42872b6f7977562e897e8d6e26b06"}
Oct 30 06:56:53.603159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.603088    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6454486969-lf5r4" event={"ID":"35bdd859-dc65-4dcc-b645-5859ea4ce046","Type":"ContainerStarted","Data":"4f93ca230603241c151300d399a031ecf4ee2810552fcdbd04e3f90349bd188c"}
Oct 30 06:56:53.603159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.603125    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6454486969-lf5r4" event={"ID":"35bdd859-dc65-4dcc-b645-5859ea4ce046","Type":"ContainerStarted","Data":"efea7a7f35f8b2b05ca27c40a7785d7173c561d09105064fd1beedc1fb7c2037"}
Oct 30 06:56:53.603329 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.603260    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:56:53.642408 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.641650    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-tfhwn-wrv42" podStartSLOduration=1.6416345799999998 podStartE2EDuration="1.64163458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:53.640572878 +0000 UTC m=+16.348453049" watchObservedRunningTime="2026-10-30 06:56:53.64163458 +0000 UTC m=+16.349514749"
Oct 30 06:56:53.692885 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:53.690069    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6454486969-lf5r4" podStartSLOduration=1.690056512 podStartE2EDuration="1.690056512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:53.689746363 +0000 UTC m=+16.397626535" watchObservedRunningTime="2026-10-30 06:56:53.690056512 +0000 UTC m=+16.397936675"
Oct 30 06:56:54.585512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:54.585433    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6xts_10492054-f044-4bee-93c4-e316fc500bff/dns/0.log"
Oct 30 06:56:54.610943 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:54.610876    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg" event={"ID":"8cd4caed-1edf-464d-9f67-9156311d271a","Type":"ContainerStarted","Data":"3d4361965ac9da79d4e40e1dcdbc9ba60a28d83c625bd8e0feb6d51c8ef37e6f"}
Oct 30 06:56:54.652742 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:54.652694    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg" podStartSLOduration=1.520382885 podStartE2EDuration="2.652676174s" totalImagesPullingTime="1.132293289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:56:54.651517185 +0000 UTC m=+17.359397356" watchObservedRunningTime="2026-10-30 06:56:54.652676174 +0000 UTC m=+17.360556344"
Oct 30 06:56:54.785180 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:54.785148    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6xts_10492054-f044-4bee-93c4-e316fc500bff/kube-rbac-proxy/0.log"
Oct 30 06:56:55.584837 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:55.584805    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kg9qk_334689c1-93d2-4b74-8d46-20890f606782/dns-node-resolver/0.log"
Oct 30 06:56:55.615869 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:55.615808    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:55.620875 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:55.620834    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-vgnfg"
Oct 30 06:56:55.985639 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:55.985608    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6454486969-lf5r4_35bdd859-dc65-4dcc-b645-5859ea4ce046/registry/0.log"
Oct 30 06:56:56.187209 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:56.187180    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b74f6655f-cf7cw_7b33b614-d743-45a3-a9e0-117db6e23f6e/registry/0.log"
Oct 30 06:56:56.385159 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:56.385116    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8b55fb966-6lrtj_a47ad62b-dd57-4c62-bc04-c688238cbe85/registry/0.log"
Oct 30 06:56:56.587090 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:56.587061    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fnh8d_dae48309-e15e-4919-a6d3-051758b7a23e/node-ca/0.log"
Oct 30 06:56:57.188252 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:57.188222    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-789654ff5-xkswj_5d01ad1b-d546-48f6-b5b8-980de74eb623/router/0.log"
Oct 30 06:56:57.785509 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:57.785471    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xghrm_3a361442-634d-4ff5-990a-29095aa6264d/serve-healthcheck-canary/0.log"
Oct 30 06:56:59.063116 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:59.063073    5073 patch_prober.go:29] interesting pod/image-registry-6b74f6655f-cf7cw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 06:56:59.063587 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:59.063127    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 06:56:59.574569 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:56:59.574533    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l6xts"
Oct 30 06:57:01.154626 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.154586    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8dl2"]
Oct 30 06:57:01.194177 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.194141    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.224699 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.224664    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 06:57:01.224879 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.224862    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 06:57:01.236352 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.236319    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-djnbg\""
Oct 30 06:57:01.236495 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.236402    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 06:57:01.237019 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.237002    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 06:57:01.277878 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.277831    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278034 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.277899    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-wtmp\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278034 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278006    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-sys\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278117 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278040    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-root\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278117 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278062    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-tls\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278214 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278151    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-textfile\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278214 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278182    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-metrics-client-ca\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278398 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278374    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2cg\" (UniqueName: \"kubernetes.io/projected/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-kube-api-access-jc2cg\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.278480 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.278459    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379441 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379402    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379629 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379452    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379629 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379472    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-wtmp\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379629 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379629    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-wtmp\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379644    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-sys\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379671    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-root\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379687    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-tls\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379734    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-textfile\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379753    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-sys\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379767    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-metrics-client-ca\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.379822 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379760    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-root\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.380187 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.379846    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2cg\" (UniqueName: \"kubernetes.io/projected/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-kube-api-access-jc2cg\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.380187 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.380117    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-textfile\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.380293 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.380217    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.380328 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.380295    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-metrics-client-ca\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.382515 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.382489    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-tls\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.382613 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.382567    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.402436 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.402411    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2cg\" (UniqueName: \"kubernetes.io/projected/32602ee3-cc2f-4e73-9eb5-5481a6022fbc-kube-api-access-jc2cg\") pod \"node-exporter-s8dl2\" (UID: \"32602ee3-cc2f-4e73-9eb5-5481a6022fbc\") " pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.508095 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.508012    5073 patch_prober.go:29] interesting pod/image-registry-6b74f6655f-cf7cw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 06:57:01.508095 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.508082    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 06:57:01.572329 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.572296    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8dl2"
Oct 30 06:57:01.617812 ip-10-0-132-33 kubenswrapper[5073]: W1030 06:57:01.617778    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32602ee3_cc2f_4e73_9eb5_5481a6022fbc.slice/crio-2fa739bc23b38592e5c6989fba6406f16381456af5df1653ead92f94064aa700 WatchSource:0}: Error finding container 2fa739bc23b38592e5c6989fba6406f16381456af5df1653ead92f94064aa700: Status 404 returned error can't find the container with id 2fa739bc23b38592e5c6989fba6406f16381456af5df1653ead92f94064aa700
Oct 30 06:57:01.650456 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:01.650413    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8dl2" event={"ID":"32602ee3-cc2f-4e73-9eb5-5481a6022fbc","Type":"ContainerStarted","Data":"2fa739bc23b38592e5c6989fba6406f16381456af5df1653ead92f94064aa700"}
Oct 30 06:57:02.441350 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:02.441308    5073 patch_prober.go:29] interesting pod/image-registry-8b55fb966-6lrtj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 06:57:02.441872 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:02.441375    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj" podUID="a47ad62b-dd57-4c62-bc04-c688238cbe85" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 06:57:03.663073 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:03.663029    5073 generic.go:356] "Generic (PLEG): container finished" podID="32602ee3-cc2f-4e73-9eb5-5481a6022fbc" containerID="ef6751d956471b48bc81d029dff11640a5097085140f58f397561aab467934ef" exitCode=0
Oct 30 06:57:03.663486 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:03.663117    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8dl2" event={"ID":"32602ee3-cc2f-4e73-9eb5-5481a6022fbc","Type":"ContainerDied","Data":"ef6751d956471b48bc81d029dff11640a5097085140f58f397561aab467934ef"}
Oct 30 06:57:04.670364 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:04.670325    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8dl2" event={"ID":"32602ee3-cc2f-4e73-9eb5-5481a6022fbc","Type":"ContainerStarted","Data":"5e2eda3557ee112ab7cea83acdc10e6f7847af8586141a11d62add070ba4b0ba"}
Oct 30 06:57:04.670808 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:04.670393    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8dl2" event={"ID":"32602ee3-cc2f-4e73-9eb5-5481a6022fbc","Type":"ContainerStarted","Data":"b8e54cc941273018ef992355e577ab975b791bac02e6744679d8f86058f03755"}
Oct 30 06:57:04.723783 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:04.723728    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8dl2" podStartSLOduration=2.290704057 podStartE2EDuration="3.723713976s" totalImagesPullingTime="1.340867178s" totalInitContainerRuntime="92.142741ms" isStatefulPod=true podCreationTimestamp="2026-10-30 06:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:57:04.723552599 +0000 UTC m=+27.431432769" watchObservedRunningTime="2026-10-30 06:57:04.723713976 +0000 UTC m=+27.431594186"
Oct 30 06:57:06.566247 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:06.565613    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jlk9l"
Oct 30 06:57:09.695754 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:09.695676    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-nkjdj" event={"ID":"7b6d3dbf-ff16-483c-9025-4198dede4828","Type":"ContainerStarted","Data":"ccc89f3efcb2f302ec8ea4ed091dd2a458f4c87d43f9e1c9f2847bbf21709156"}
Oct 30 06:57:09.696178 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:09.695842    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:57:09.697461 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:09.697432    5073 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-nkjdj container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.30:8080/\": dial tcp 10.132.0.30:8080: connect: connection refused" start-of-body=
Oct 30 06:57:09.697563 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:09.697479    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-nkjdj" podUID="7b6d3dbf-ff16-483c-9025-4198dede4828" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.30:8080/\": dial tcp 10.132.0.30:8080: connect: connection refused"
Oct 30 06:57:09.749112 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:09.749065    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-nkjdj" podStartSLOduration=1.447251136 podStartE2EDuration="17.749053272s" totalImagesPullingTime="16.301802136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 06:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 06:57:09.746352865 +0000 UTC m=+32.454233034" watchObservedRunningTime="2026-10-30 06:57:09.749053272 +0000 UTC m=+32.456933474"
Oct 30 06:57:10.709354 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:10.709318    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-nkjdj"
Oct 30 06:57:11.507542 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:11.507504    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:57:12.441958 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:12.441926    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:57:13.925829 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:57:13.925786    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 06:57:14.617100 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:14.617064    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6454486969-lf5r4"
Oct 30 06:57:14.713932 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:14.713826    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b74f6655f-cf7cw"]
Oct 30 06:57:17.462433 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.462322    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj" podUID="a47ad62b-dd57-4c62-bc04-c688238cbe85" containerName="registry" containerID="cri-o://54ba1d9e59cc10b5e35b63e3eeb78e11b34ee3dd7b29ba25579d8d816a90bc45" gracePeriod=30
Oct 30 06:57:17.756530 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.756488    5073 generic.go:356] "Generic (PLEG): container finished" podID="a47ad62b-dd57-4c62-bc04-c688238cbe85" containerID="54ba1d9e59cc10b5e35b63e3eeb78e11b34ee3dd7b29ba25579d8d816a90bc45" exitCode=0
Oct 30 06:57:17.756698 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.756580    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj" event={"ID":"a47ad62b-dd57-4c62-bc04-c688238cbe85","Type":"ContainerDied","Data":"54ba1d9e59cc10b5e35b63e3eeb78e11b34ee3dd7b29ba25579d8d816a90bc45"}
Oct 30 06:57:17.756698 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.756673    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj" event={"ID":"a47ad62b-dd57-4c62-bc04-c688238cbe85","Type":"ContainerDied","Data":"1a60375443e787d65a12335b9b6435fe4f46fe02d3fc022e7105f56f4a8b6410"}
Oct 30 06:57:17.756698 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.756696    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a60375443e787d65a12335b9b6435fe4f46fe02d3fc022e7105f56f4a8b6410"
Oct 30 06:57:17.793909 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.793879    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:57:17.938923 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.938883    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939107 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.938950    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939107 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939014    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939107 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939047    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939274 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939119    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939274 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939152    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939274 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939185    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939274 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939214    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") pod \"a47ad62b-dd57-4c62-bc04-c688238cbe85\" (UID: \"a47ad62b-dd57-4c62-bc04-c688238cbe85\") "
Oct 30 06:57:17.939481 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939351    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:57:17.939481 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939364    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:57:17.939587 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939523    5073 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-trusted-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:17.939587 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.939544    5073 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-certificates\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:17.942341 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.942306    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:17.942538 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.942519    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:17.942633 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.942549    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "kube-api-access-5nnws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:17.942701 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.942615    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 06:57:17.943268 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.943238    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 06:57:17.946694 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:17.946669    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted" pod "a47ad62b-dd57-4c62-bc04-c688238cbe85" (UID: "a47ad62b-dd57-4c62-bc04-c688238cbe85"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 06:57:18.040798 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.040715    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nnws\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-kube-api-access-5nnws\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:18.040798 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.040750    5073 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-registry-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:18.040798 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.040764    5073 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a47ad62b-dd57-4c62-bc04-c688238cbe85-ca-trust-extracted\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:18.040798 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.040776    5073 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-installation-pull-secrets\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:18.040798 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.040791    5073 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a47ad62b-dd57-4c62-bc04-c688238cbe85-image-registry-private-configuration\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:18.041088 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.040807    5073 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a47ad62b-dd57-4c62-bc04-c688238cbe85-bound-sa-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:18.760735 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.760703    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b55fb966-6lrtj"
Oct 30 06:57:18.820783 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.820749    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8b55fb966-6lrtj"]
Oct 30 06:57:18.832157 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:18.832128    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8b55fb966-6lrtj"]
Oct 30 06:57:19.419485 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:19.419455    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a47ad62b-dd57-4c62-bc04-c688238cbe85" path="/var/lib/kubelet/pods/a47ad62b-dd57-4c62-bc04-c688238cbe85/volumes"
Oct 30 06:57:25.846876 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:25.846823    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-v9xr8-jmxsw"]
Oct 30 06:57:25.847448 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:25.847111    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw" podUID="b3327489-8c96-4b81-b440-fd58d4d2fd0b" containerName="insights-gathering" containerID="cri-o://8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b" gracePeriod=30
Oct 30 06:57:26.148725 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.148690    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:57:26.311616 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.311580    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") pod \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") "
Oct 30 06:57:26.311835 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.311681    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") pod \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") "
Oct 30 06:57:26.311835 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.311706    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") pod \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") "
Oct 30 06:57:26.311835 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.311744    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") pod \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\" (UID: \"b3327489-8c96-4b81-b440-fd58d4d2fd0b\") "
Oct 30 06:57:26.312041 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.311992    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path" pod "b3327489-8c96-4b81-b440-fd58d4d2fd0b" (UID: "b3327489-8c96-4b81-b440-fd58d4d2fd0b"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 06:57:26.312157 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.312136    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle" pod "b3327489-8c96-4b81-b440-fd58d4d2fd0b" (UID: "b3327489-8c96-4b81-b440-fd58d4d2fd0b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:57:26.312200 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.312141    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle" pod "b3327489-8c96-4b81-b440-fd58d4d2fd0b" (UID: "b3327489-8c96-4b81-b440-fd58d4d2fd0b"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:57:26.314145 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.314121    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx" pod "b3327489-8c96-4b81-b440-fd58d4d2fd0b" (UID: "b3327489-8c96-4b81-b440-fd58d4d2fd0b"). InnerVolumeSpecName "kube-api-access-xjqmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:26.412627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.412599    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjqmx\" (UniqueName: \"kubernetes.io/projected/b3327489-8c96-4b81-b440-fd58d4d2fd0b-kube-api-access-xjqmx\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:26.412627 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.412628    5073 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-trusted-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:26.412904 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.412639    5073 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3327489-8c96-4b81-b440-fd58d4d2fd0b-service-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:26.412904 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.412649    5073 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b3327489-8c96-4b81-b440-fd58d4d2fd0b-archives-path\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:26.794939 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.794845    5073 generic.go:356] "Generic (PLEG): container finished" podID="b3327489-8c96-4b81-b440-fd58d4d2fd0b" containerID="8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b" exitCode=2
Oct 30 06:57:26.794939 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.794907    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw"
Oct 30 06:57:26.795200 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.794927    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw" event={"ID":"b3327489-8c96-4b81-b440-fd58d4d2fd0b","Type":"ContainerDied","Data":"8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b"}
Oct 30 06:57:26.795200 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.794982    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-v9xr8-jmxsw" event={"ID":"b3327489-8c96-4b81-b440-fd58d4d2fd0b","Type":"ContainerDied","Data":"a3e1b62f14c923614bb07faa2f475a60e8e2f3f83a6a3f415ad76de17c3871b9"}
Oct 30 06:57:26.795200 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.795001    5073 scope.go:122] "RemoveContainer" containerID="8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b"
Oct 30 06:57:26.804008 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.803991    5073 scope.go:122] "RemoveContainer" containerID="8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b"
Oct 30 06:57:26.804266 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:57:26.804246    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b\": container with ID starting with 8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b not found: ID does not exist" containerID="8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b"
Oct 30 06:57:26.804310 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.804274    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b"} err="failed to get container status \"8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b\": rpc error: code = NotFound desc = could not find container \"8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b\": container with ID starting with 8639675e25213a750bdddb2d45e2352040f353e2f7bcb07b5b1b7db73985a51b not found: ID does not exist"
Oct 30 06:57:26.843610 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.843586    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-v9xr8-jmxsw"]
Oct 30 06:57:26.854904 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:26.854886    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-v9xr8-jmxsw"]
Oct 30 06:57:27.423765 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:27.423732    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3327489-8c96-4b81-b440-fd58d4d2fd0b" path="/var/lib/kubelet/pods/b3327489-8c96-4b81-b440-fd58d4d2fd0b/volumes"
Oct 30 06:57:39.741511 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:39.741449    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerName="registry" containerID="cri-o://ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03" gracePeriod=30
Oct 30 06:57:40.027609 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.027582    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:57:40.118138 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118109    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118301 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118146    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118301 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118164    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118479 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118353    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118479 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118410    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118479 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118458    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118628 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118511    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.118628 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118543    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:57:40.118736 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118616    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:57:40.118945 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118924    5073 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-trusted-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.119039 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.118953    5073 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-certificates\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.120454 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.120427    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:40.120746 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.120718    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:40.120921 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.120897    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 06:57:40.120988 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.120928    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "kube-api-access-x6tvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:57:40.124904 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.124884    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 06:57:40.219209 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.219182    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") pod \"7b33b614-d743-45a3-a9e0-117db6e23f6e\" (UID: \"7b33b614-d743-45a3-a9e0-117db6e23f6e\") "
Oct 30 06:57:40.219345 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.219334    5073 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-image-registry-private-configuration\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.219400 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.219347    5073 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-registry-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.219400 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.219358    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6tvh\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-kube-api-access-x6tvh\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.219400 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.219368    5073 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b33b614-d743-45a3-a9e0-117db6e23f6e-ca-trust-extracted\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.219400 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.219377    5073 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b33b614-d743-45a3-a9e0-117db6e23f6e-bound-sa-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.221074 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.221054    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets" pod "7b33b614-d743-45a3-a9e0-117db6e23f6e" (UID: "7b33b614-d743-45a3-a9e0-117db6e23f6e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 06:57:40.320458 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.320395    5073 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b33b614-d743-45a3-a9e0-117db6e23f6e-installation-pull-secrets\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:57:40.858607 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.858565    5073 generic.go:356] "Generic (PLEG): container finished" podID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerID="ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03" exitCode=0
Oct 30 06:57:40.858607 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.858604    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw"
Oct 30 06:57:40.859067 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.858605    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" event={"ID":"7b33b614-d743-45a3-a9e0-117db6e23f6e","Type":"ContainerDied","Data":"ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03"}
Oct 30 06:57:40.859067 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.858728    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b74f6655f-cf7cw" event={"ID":"7b33b614-d743-45a3-a9e0-117db6e23f6e","Type":"ContainerDied","Data":"1e56abc7e2693c389cfab25672ff92f5bd344644de8f801ea1d72b394385ab7f"}
Oct 30 06:57:40.859067 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.858751    5073 scope.go:122] "RemoveContainer" containerID="ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03"
Oct 30 06:57:40.870309 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.870287    5073 scope.go:122] "RemoveContainer" containerID="ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03"
Oct 30 06:57:40.870603 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:57:40.870584    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03\": container with ID starting with ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03 not found: ID does not exist" containerID="ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03"
Oct 30 06:57:40.870650 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.870612    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03"} err="failed to get container status \"ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03\": rpc error: code = NotFound desc = could not find container \"ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03\": container with ID starting with ee4e49c0060ff0fafa74ed9a4091448c9cf3182ab47f8c6f3e24e426775c9f03 not found: ID does not exist"
Oct 30 06:57:40.917886 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.917863    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b74f6655f-cf7cw"]
Oct 30 06:57:40.929692 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:40.929670    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b74f6655f-cf7cw"]
Oct 30 06:57:41.420461 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:57:41.420429    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" path="/var/lib/kubelet/pods/7b33b614-d743-45a3-a9e0-117db6e23f6e/volumes"
Oct 30 06:57:43.920863 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:57:43.920809    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 06:58:13.920171 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:58:13.920135    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 06:58:19.013919 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:19.013827    5073 generic.go:356] "Generic (PLEG): container finished" podID="05e5473d-07bf-411e-b2a6-b3ada28624eb" containerID="9500734f224ac908212fa506a9a5cc831b96ce65149f0c092c62952507f5dae5" exitCode=0
Oct 30 06:58:19.013919 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:19.013899    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tfhwn-wrv42" event={"ID":"05e5473d-07bf-411e-b2a6-b3ada28624eb","Type":"ContainerDied","Data":"9500734f224ac908212fa506a9a5cc831b96ce65149f0c092c62952507f5dae5"}
Oct 30 06:58:20.150376 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.150351    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:58:20.223708 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.223680    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm\" (UniqueName: \"kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm\") pod \"05e5473d-07bf-411e-b2a6-b3ada28624eb\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") "
Oct 30 06:58:20.223862 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.223737    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle\") pod \"05e5473d-07bf-411e-b2a6-b3ada28624eb\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") "
Oct 30 06:58:20.223862 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.223758    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path\") pod \"05e5473d-07bf-411e-b2a6-b3ada28624eb\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") "
Oct 30 06:58:20.223862 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.223796    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle\") pod \"05e5473d-07bf-411e-b2a6-b3ada28624eb\" (UID: \"05e5473d-07bf-411e-b2a6-b3ada28624eb\") "
Oct 30 06:58:20.224154 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.224130    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path" pod "05e5473d-07bf-411e-b2a6-b3ada28624eb" (UID: "05e5473d-07bf-411e-b2a6-b3ada28624eb"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 06:58:20.224154 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.224143    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle" pod "05e5473d-07bf-411e-b2a6-b3ada28624eb" (UID: "05e5473d-07bf-411e-b2a6-b3ada28624eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:58:20.224259 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.224175    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle" pod "05e5473d-07bf-411e-b2a6-b3ada28624eb" (UID: "05e5473d-07bf-411e-b2a6-b3ada28624eb"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 06:58:20.225846 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.225829    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm" pod "05e5473d-07bf-411e-b2a6-b3ada28624eb" (UID: "05e5473d-07bf-411e-b2a6-b3ada28624eb"). InnerVolumeSpecName "kube-api-access-4kzxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 06:58:20.324317 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.324247    5073 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-service-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:58:20.324317 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.324272    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kzxm\" (UniqueName: \"kubernetes.io/projected/05e5473d-07bf-411e-b2a6-b3ada28624eb-kube-api-access-4kzxm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:58:20.324317 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.324281    5073 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05e5473d-07bf-411e-b2a6-b3ada28624eb-trusted-ca-bundle\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:58:20.324317 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:20.324290    5073 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/05e5473d-07bf-411e-b2a6-b3ada28624eb-archives-path\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 06:58:21.023512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:21.023470    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-tfhwn-wrv42" event={"ID":"05e5473d-07bf-411e-b2a6-b3ada28624eb","Type":"ContainerDied","Data":"44d03fdae9861ee21e4482c7271a96df6ed42872b6f7977562e897e8d6e26b06"}
Oct 30 06:58:21.023512 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:21.023496    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-tfhwn-wrv42"
Oct 30 06:58:21.023709 ip-10-0-132-33 kubenswrapper[5073]: I1030 06:58:21.023557    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44d03fdae9861ee21e4482c7271a96df6ed42872b6f7977562e897e8d6e26b06"
Oct 30 06:58:43.921060 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:58:43.921018    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 06:59:13.920104 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:59:13.920020    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 06:59:43.921631 ip-10-0-132-33 kubenswrapper[5073]: E1030 06:59:43.921595    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:00:07.118396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118356    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"]
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118704    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b3327489-8c96-4b81-b440-fd58d4d2fd0b" containerName="insights-gathering"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118715    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3327489-8c96-4b81-b440-fd58d4d2fd0b" containerName="insights-gathering"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118734    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a47ad62b-dd57-4c62-bc04-c688238cbe85" containerName="registry"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118740    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a47ad62b-dd57-4c62-bc04-c688238cbe85" containerName="registry"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118761    5073 cpu_manager.go:414] "containerMap: removing container" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerName="registry"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118766    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerName="registry"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118776    5073 cpu_manager.go:414] "containerMap: removing container" podUID="05e5473d-07bf-411e-b2a6-b3ada28624eb" containerName="insights-gathering"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118781    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e5473d-07bf-411e-b2a6-b3ada28624eb" containerName="insights-gathering"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118843    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3327489-8c96-4b81-b440-fd58d4d2fd0b" containerName="insights-gathering"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118868    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a47ad62b-dd57-4c62-bc04-c688238cbe85" containerName="registry"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118880    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b33b614-d743-45a3-a9e0-117db6e23f6e" containerName="registry"
Oct 30 07:00:07.118909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.118888    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="05e5473d-07bf-411e-b2a6-b3ada28624eb" containerName="insights-gathering"
Oct 30 07:00:07.121988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.121965    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.135792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.135767    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sp9gr\""
Oct 30 07:00:07.136072 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.136055    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 07:00:07.148814 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.148788    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"]
Oct 30 07:00:07.233784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.233748    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.233784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.233790    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.233811    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.233828    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.233942    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.233997    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4bhx\" (UniqueName: \"kubernetes.io/projected/f0f75d92-2523-4dbe-89d0-628ebd8c8690-kube-api-access-g4bhx\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.234021    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.234037    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.234264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.234056    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.267232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.267194    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"]
Oct 30 07:00:07.270586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.270568    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.287240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.287216    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-dwk4f\""
Oct 30 07:00:07.295216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.295189    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"]
Oct 30 07:00:07.335196 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335164    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335204    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335225    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335240    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335261    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335291    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4bhx\" (UniqueName: \"kubernetes.io/projected/f0f75d92-2523-4dbe-89d0-628ebd8c8690-kube-api-access-g4bhx\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335321    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335345    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335371    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.335776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335696    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.336015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.335986    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.336015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.336022    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.336220 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.336166    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.336316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.336290    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.337563 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.337539    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.338025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.338006    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.358153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.358126    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0f75d92-2523-4dbe-89d0-628ebd8c8690-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.358566 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.358548    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4bhx\" (UniqueName: \"kubernetes.io/projected/f0f75d92-2523-4dbe-89d0-628ebd8c8690-kube-api-access-g4bhx\") pod \"maas-default-gateway-openshift-default-6dcf757899-6v6gx\" (UID: \"f0f75d92-2523-4dbe-89d0-628ebd8c8690\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.436588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436554    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436603    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436677    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436725    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436756    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdshv\" (UniqueName: \"kubernetes.io/projected/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-kube-api-access-qdshv\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436780    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436891    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.436941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436920    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.437014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.436997    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.437459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.437438    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:07.538067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538036    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538086    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538106    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538145    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538173    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdshv\" (UniqueName: \"kubernetes.io/projected/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-kube-api-access-qdshv\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538198    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538225    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538250    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538514    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538542    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538646    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538749 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538725    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.538846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538826    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.539011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.538994    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.540437 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.540416    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.540700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.540678    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.560769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.560739    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.560769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.560764    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdshv\" (UniqueName: \"kubernetes.io/projected/2f5ace0b-c216-4eb9-9343-c4693b1e92c1-kube-api-access-qdshv\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn\" (UID: \"2f5ace0b-c216-4eb9-9343-c4693b1e92c1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.582891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.582871    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:07.751305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.751275    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"]
Oct 30 07:00:07.753722 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:00:07.753687    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f75d92_2523_4dbe_89d0_628ebd8c8690.slice/crio-d49c6245801f7bbe23c013072fb7a300a837102e13013ba494e1d9c7ea6e2075 WatchSource:0}: Error finding container d49c6245801f7bbe23c013072fb7a300a837102e13013ba494e1d9c7ea6e2075: Status 404 returned error can't find the container with id d49c6245801f7bbe23c013072fb7a300a837102e13013ba494e1d9c7ea6e2075
Oct 30 07:00:07.884483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:07.884450    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"]
Oct 30 07:00:07.885406 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:00:07.885381    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5ace0b_c216_4eb9_9343_c4693b1e92c1.slice/crio-5838c572efb585fff22cad88eb5b30022604b25a80624eb5734dd5604eb50de2 WatchSource:0}: Error finding container 5838c572efb585fff22cad88eb5b30022604b25a80624eb5734dd5604eb50de2: Status 404 returned error can't find the container with id 5838c572efb585fff22cad88eb5b30022604b25a80624eb5734dd5604eb50de2
Oct 30 07:00:08.454594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:08.454558    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn" event={"ID":"2f5ace0b-c216-4eb9-9343-c4693b1e92c1","Type":"ContainerStarted","Data":"5838c572efb585fff22cad88eb5b30022604b25a80624eb5734dd5604eb50de2"}
Oct 30 07:00:08.455765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:08.455736    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" event={"ID":"f0f75d92-2523-4dbe-89d0-628ebd8c8690","Type":"ContainerStarted","Data":"d49c6245801f7bbe23c013072fb7a300a837102e13013ba494e1d9c7ea6e2075"}
Oct 30 07:00:10.874401 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:10.874368    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:00:10.874686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:10.874440    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:00:10.874686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:10.874473    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:00:10.882957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:10.882928    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:00:10.883031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:10.882993    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:00:10.883031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:10.883022    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:00:11.471902 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:11.471843    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn" event={"ID":"2f5ace0b-c216-4eb9-9343-c4693b1e92c1","Type":"ContainerStarted","Data":"d4fc01a37f6a621ae89cb4f68630b4936ff7bdcab565e18d4acafb8d0acb8163"}
Oct 30 07:00:11.473470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:11.473449    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" event={"ID":"f0f75d92-2523-4dbe-89d0-628ebd8c8690","Type":"ContainerStarted","Data":"f8096f3f50818883409fe58d51e939d05d8088b1ab270b34c5a88cbead995ae8"}
Oct 30 07:00:11.538722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:11.538645    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn" podStartSLOduration=1.552396737 podStartE2EDuration="4.538633108s" totalImagesPullingTime="2.986236371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:00:11.527299002 +0000 UTC m=+214.235179170" watchObservedRunningTime="2026-10-30 07:00:11.538633108 +0000 UTC m=+214.246513273"
Oct 30 07:00:11.572409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:11.572359    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podStartSLOduration=1.445691622 podStartE2EDuration="4.57233756s" totalImagesPullingTime="3.126645938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:00:11.571009851 +0000 UTC m=+214.278890051" watchObservedRunningTime="2026-10-30 07:00:11.57233756 +0000 UTC m=+214.280217729"
Oct 30 07:00:11.583203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:11.583176    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:11.587467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:11.587441    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:12.438365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:12.438332    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:12.442991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:12.442967    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:12.477319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:12.477291    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:12.477468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:12.477445    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:12.478070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:12.478052    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn"
Oct 30 07:00:12.478209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:12.478192    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:00:13.920379 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:00:13.920339    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:00:37.502781 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.502748    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"]
Oct 30 07:00:37.506741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.506716    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.539939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.539905    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"]
Oct 30 07:00:37.596433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.596402    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 07:00:37.596760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.596735    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 07:00:37.596929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.596756    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 07:00:37.596929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.596795    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-q568p\""
Oct 30 07:00:37.596929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.596829    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 07:00:37.597122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.597075    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 07:00:37.597804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.597776    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-webhook-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.597926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.597887    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-tmp\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.597926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.597914    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-metrics-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.598011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.597934    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.598074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.598052    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc9jc\" (UniqueName: \"kubernetes.io/projected/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-kube-api-access-tc9jc\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.598128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.598091    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-manifests\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699045    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc9jc\" (UniqueName: \"kubernetes.io/projected/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-kube-api-access-tc9jc\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699086    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-manifests\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699219    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-webhook-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699287    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-tmp\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699322    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-metrics-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699425 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699352    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.699480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.699467    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-manifests\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.701613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.701585    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-tmp\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.701799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.701778    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-webhook-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.701898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.701839    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.701898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.701880    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-metrics-cert\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.724344 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.724319    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc9jc\" (UniqueName: \"kubernetes.io/projected/d8a70ea0-8b1c-4b11-abc0-c3c7560df018-kube-api-access-tc9jc\") pod \"opendatahub-operator-controller-manager-85f89f7bd7-ns45p\" (UID: \"d8a70ea0-8b1c-4b11-abc0-c3c7560df018\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:37.821372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:37.821292    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:38.176748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:38.176723    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"]
Oct 30 07:00:38.178794 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:00:38.178765    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a70ea0_8b1c_4b11_abc0_c3c7560df018.slice/crio-34a527d9bb6ffb00df57b74962439521da85e1b23f607b22b608c574d2bd366a WatchSource:0}: Error finding container 34a527d9bb6ffb00df57b74962439521da85e1b23f607b22b608c574d2bd366a: Status 404 returned error can't find the container with id 34a527d9bb6ffb00df57b74962439521da85e1b23f607b22b608c574d2bd366a
Oct 30 07:00:38.582471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:38.582390    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p" event={"ID":"d8a70ea0-8b1c-4b11-abc0-c3c7560df018","Type":"ContainerStarted","Data":"34a527d9bb6ffb00df57b74962439521da85e1b23f607b22b608c574d2bd366a"}
Oct 30 07:00:41.597346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:41.597309    5073 generic.go:356] "Generic (PLEG): container finished" podID="d8a70ea0-8b1c-4b11-abc0-c3c7560df018" containerID="c5601daff41957fe0f09c502ee6fef12e4f24d65de8ffe673cf4da3fe32d6877" exitCode=0
Oct 30 07:00:41.597735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:41.597376    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p" event={"ID":"d8a70ea0-8b1c-4b11-abc0-c3c7560df018","Type":"ContainerDied","Data":"c5601daff41957fe0f09c502ee6fef12e4f24d65de8ffe673cf4da3fe32d6877"}
Oct 30 07:00:42.603364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:42.603332    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p" event={"ID":"d8a70ea0-8b1c-4b11-abc0-c3c7560df018","Type":"ContainerStarted","Data":"73dcf8150701c2c882b79ab14fef1dcb917a7d51450cd18ee53a24a31e8b053c"}
Oct 30 07:00:42.603763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:42.603450    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:00:42.681001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:42.680948    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p" podStartSLOduration=2.272989435 podStartE2EDuration="5.680934085s" totalImagesPullingTime="2.982305417s" totalInitContainerRuntime="425.639233ms" isStatefulPod=false podCreationTimestamp="2026-10-30 07:00:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:00:42.678220178 +0000 UTC m=+245.386100348" watchObservedRunningTime="2026-10-30 07:00:42.680934085 +0000 UTC m=+245.388814255"
Oct 30 07:00:43.920556 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:00:43.920519    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:00:53.610294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:00:53.610264    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85f89f7bd7-ns45p"
Oct 30 07:01:00.862586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:00.862551    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"]
Oct 30 07:01:00.865803 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:00.865787    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:00.885080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:00.885058    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 07:01:00.885195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:00.885075    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 07:01:00.896373 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:00.896345    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g6g6q\""
Oct 30 07:01:00.898025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:00.898002    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"]
Oct 30 07:01:01.012087 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.012051    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7sqv\" (UniqueName: \"kubernetes.io/projected/c3a16aa5-0190-4e9c-ab94-415c993ebc77-kube-api-access-z7sqv\") pod \"kuadrant-operator-controller-manager-678d87766f-jnpp6\" (UID: \"c3a16aa5-0190-4e9c-ab94-415c993ebc77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.012283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.012092    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a16aa5-0190-4e9c-ab94-415c993ebc77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-jnpp6\" (UID: \"c3a16aa5-0190-4e9c-ab94-415c993ebc77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.113614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.113526    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7sqv\" (UniqueName: \"kubernetes.io/projected/c3a16aa5-0190-4e9c-ab94-415c993ebc77-kube-api-access-z7sqv\") pod \"kuadrant-operator-controller-manager-678d87766f-jnpp6\" (UID: \"c3a16aa5-0190-4e9c-ab94-415c993ebc77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.113614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.113566    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a16aa5-0190-4e9c-ab94-415c993ebc77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-jnpp6\" (UID: \"c3a16aa5-0190-4e9c-ab94-415c993ebc77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.113953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.113935    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3a16aa5-0190-4e9c-ab94-415c993ebc77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-jnpp6\" (UID: \"c3a16aa5-0190-4e9c-ab94-415c993ebc77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.145721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.145687    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7sqv\" (UniqueName: \"kubernetes.io/projected/c3a16aa5-0190-4e9c-ab94-415c993ebc77-kube-api-access-z7sqv\") pod \"kuadrant-operator-controller-manager-678d87766f-jnpp6\" (UID: \"c3a16aa5-0190-4e9c-ab94-415c993ebc77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.178622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.178586    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:01.515766 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.515739    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"]
Oct 30 07:01:01.517321 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:01:01.517292    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a16aa5_0190_4e9c_ab94_415c993ebc77.slice/crio-4656952acd52b738a998d8cdab97ca93856082d30fc33e174ddb4786eed453b6 WatchSource:0}: Error finding container 4656952acd52b738a998d8cdab97ca93856082d30fc33e174ddb4786eed453b6: Status 404 returned error can't find the container with id 4656952acd52b738a998d8cdab97ca93856082d30fc33e174ddb4786eed453b6
Oct 30 07:01:01.683566 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:01.683524    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6" event={"ID":"c3a16aa5-0190-4e9c-ab94-415c993ebc77","Type":"ContainerStarted","Data":"4656952acd52b738a998d8cdab97ca93856082d30fc33e174ddb4786eed453b6"}
Oct 30 07:01:05.706897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:05.706838    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6" event={"ID":"c3a16aa5-0190-4e9c-ab94-415c993ebc77","Type":"ContainerStarted","Data":"e7e5e72c3ae963d61e6ee1f8ad1eb406f4ca001a64dfff47d8f28a45a294b073"}
Oct 30 07:01:05.707305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:05.706933    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:05.782539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:05.782493    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6" podStartSLOduration=1.694759124 podStartE2EDuration="5.782477469s" totalImagesPullingTime="4.087718345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:01:05.782192094 +0000 UTC m=+268.490072263" watchObservedRunningTime="2026-10-30 07:01:05.782477469 +0000 UTC m=+268.490357639"
Oct 30 07:01:08.893414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:08.893375    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"]
Oct 30 07:01:08.896995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:08.896976    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:08.926168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:08.926148    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vxmrl\""
Oct 30 07:01:08.928773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:08.928750    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"]
Oct 30 07:01:08.976546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:08.976517    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfrh\" (UniqueName: \"kubernetes.io/projected/caa1fc89-9fb3-4d05-b054-e3654712df59-kube-api-access-hqfrh\") pod \"authorino-operator-7b7bb4bc77-rv7dp\" (UID: \"caa1fc89-9fb3-4d05-b054-e3654712df59\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:09.077142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:09.077111    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfrh\" (UniqueName: \"kubernetes.io/projected/caa1fc89-9fb3-4d05-b054-e3654712df59-kube-api-access-hqfrh\") pod \"authorino-operator-7b7bb4bc77-rv7dp\" (UID: \"caa1fc89-9fb3-4d05-b054-e3654712df59\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:09.100287 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:09.100258    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfrh\" (UniqueName: \"kubernetes.io/projected/caa1fc89-9fb3-4d05-b054-e3654712df59-kube-api-access-hqfrh\") pod \"authorino-operator-7b7bb4bc77-rv7dp\" (UID: \"caa1fc89-9fb3-4d05-b054-e3654712df59\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:09.209785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:09.209717    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:09.507332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:09.507305    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"]
Oct 30 07:01:09.508807 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:01:09.508782    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa1fc89_9fb3_4d05_b054_e3654712df59.slice/crio-974b779c8be6b7e04fcc9feb6d7d6177b64f318be39ff78585faa88c21a1af1b WatchSource:0}: Error finding container 974b779c8be6b7e04fcc9feb6d7d6177b64f318be39ff78585faa88c21a1af1b: Status 404 returned error can't find the container with id 974b779c8be6b7e04fcc9feb6d7d6177b64f318be39ff78585faa88c21a1af1b
Oct 30 07:01:09.731921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:09.731886    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp" event={"ID":"caa1fc89-9fb3-4d05-b054-e3654712df59","Type":"ContainerStarted","Data":"974b779c8be6b7e04fcc9feb6d7d6177b64f318be39ff78585faa88c21a1af1b"}
Oct 30 07:01:11.742442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:11.742412    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp" event={"ID":"caa1fc89-9fb3-4d05-b054-e3654712df59","Type":"ContainerStarted","Data":"aac7f7e9b17b5bd0da5cbbe1a448e29cf205d8b34d2f7af795b4c4a95a0ee5d9"}
Oct 30 07:01:11.742827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:11.742551    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:11.783020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:11.782973    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp" podStartSLOduration=2.325627121 podStartE2EDuration="3.782959341s" totalImagesPullingTime="1.45733222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:01:11.781384885 +0000 UTC m=+274.489265054" watchObservedRunningTime="2026-10-30 07:01:11.782959341 +0000 UTC m=+274.490839487"
Oct 30 07:01:13.809811 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.809781    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:13.813327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.813297    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:13.834871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.834828    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:13.869299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.869269    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"]
Oct 30 07:01:13.873209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.873191    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.889494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.889474    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 07:01:13.895174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.895152    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"]
Oct 30 07:01:13.901317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.901298    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lfn59\""
Oct 30 07:01:13.901568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.901546    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mgfvk\""
Oct 30 07:01:13.914008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.913982    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914035    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914138    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrr7\" (UniqueName: \"kubernetes.io/projected/026c75e2-46b4-47a2-b579-d51e93c9fefe-kube-api-access-tdrr7\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914220    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file\") pod \"limitador-limitador-74dfcfb894-dtr9m\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:13.914359 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914337    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnt5g\" (UniqueName: \"kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g\") pod \"limitador-limitador-74dfcfb894-dtr9m\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:13.914397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914380    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914419    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914515    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914551    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914621    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.914693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.914651    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026c75e2-46b4-47a2-b579-d51e93c9fefe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:13.926144 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:01:13.926121    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:01:13.944061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:13.944037    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:14.015629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015593    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnt5g\" (UniqueName: \"kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g\") pod \"limitador-limitador-74dfcfb894-dtr9m\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:14.015629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015634    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.015901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015657    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.015901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015677    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.015901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015791    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.015901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015848    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015904    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026c75e2-46b4-47a2-b579-d51e93c9fefe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015945    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.015992    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016024    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrr7\" (UniqueName: \"kubernetes.io/projected/026c75e2-46b4-47a2-b579-d51e93c9fefe-kube-api-access-tdrr7\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016093    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file\") pod \"limitador-limitador-74dfcfb894-dtr9m\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:14.016385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016227    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016278    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016460    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016682    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.016769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016751    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file\") pod \"limitador-limitador-74dfcfb894-dtr9m\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:14.016988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.016963    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/026c75e2-46b4-47a2-b579-d51e93c9fefe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.018095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.018067    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.018170 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.018153    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.043095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.043063    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnt5g\" (UniqueName: \"kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g\") pod \"limitador-limitador-74dfcfb894-dtr9m\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:14.043884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.043840    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/026c75e2-46b4-47a2-b579-d51e93c9fefe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.047895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.047873    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrr7\" (UniqueName: \"kubernetes.io/projected/026c75e2-46b4-47a2-b579-d51e93c9fefe-kube-api-access-tdrr7\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln\" (UID: \"026c75e2-46b4-47a2-b579-d51e93c9fefe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.126133 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.126102    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:14.186487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.186212    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:14.426637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.426607    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:14.428287 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:01:14.428260    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f1f9b0_8e49_4a05_97b6_b3f990fdc4da.slice/crio-1f0f77d440246d740912cfa6dacbedac181eecc643fe46f04e7d4e1e05420639 WatchSource:0}: Error finding container 1f0f77d440246d740912cfa6dacbedac181eecc643fe46f04e7d4e1e05420639: Status 404 returned error can't find the container with id 1f0f77d440246d740912cfa6dacbedac181eecc643fe46f04e7d4e1e05420639
Oct 30 07:01:14.498066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.498040    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"]
Oct 30 07:01:14.498890 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:01:14.498845    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026c75e2_46b4_47a2_b579_d51e93c9fefe.slice/crio-deb09cf670962d7934fac8138728f1cd04f79a5aaba0a128ce9973d8afde93fd WatchSource:0}: Error finding container deb09cf670962d7934fac8138728f1cd04f79a5aaba0a128ce9973d8afde93fd: Status 404 returned error can't find the container with id deb09cf670962d7934fac8138728f1cd04f79a5aaba0a128ce9973d8afde93fd
Oct 30 07:01:14.501120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.501089    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:01:14.501193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.501153    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:01:14.501193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.501188    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:01:14.758514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.758431    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m" event={"ID":"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da","Type":"ContainerStarted","Data":"1f0f77d440246d740912cfa6dacbedac181eecc643fe46f04e7d4e1e05420639"}
Oct 30 07:01:14.760187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.760156    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln" event={"ID":"026c75e2-46b4-47a2-b579-d51e93c9fefe","Type":"ContainerStarted","Data":"db39a4691465b1049354c8071358f711e8dc2f36dbecb25959e99c4289c3d9bb"}
Oct 30 07:01:14.760323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.760205    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln" event={"ID":"026c75e2-46b4-47a2-b579-d51e93c9fefe","Type":"ContainerStarted","Data":"deb09cf670962d7934fac8138728f1cd04f79a5aaba0a128ce9973d8afde93fd"}
Oct 30 07:01:14.804946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:14.804898    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln" podStartSLOduration=1.80488232 podStartE2EDuration="1.80488232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:01:14.804622478 +0000 UTC m=+277.512502649" watchObservedRunningTime="2026-10-30 07:01:14.80488232 +0000 UTC m=+277.512762488"
Oct 30 07:01:15.187189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:15.187160    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:15.191551 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:15.191526    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:15.764794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:15.764764    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:15.765608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:15.765589    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln"
Oct 30 07:01:16.718604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:16.718575    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-jnpp6"
Oct 30 07:01:19.787909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:19.787878    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m" event={"ID":"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da","Type":"ContainerStarted","Data":"c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a"}
Oct 30 07:01:19.788245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:19.787973    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:19.827710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:19.827672    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m" podStartSLOduration=1.5469999639999998 podStartE2EDuration="6.827657829s" totalImagesPullingTime="5.280657865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:01:19.826409585 +0000 UTC m=+282.534289754" watchObservedRunningTime="2026-10-30 07:01:19.827657829 +0000 UTC m=+282.535537998"
Oct 30 07:01:22.748511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:22.748481    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-rv7dp"
Oct 30 07:01:30.793336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:30.793307    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:31.737284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:31.737254    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:31.737455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:31.737425    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m" podUID="a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" containerName="limitador" containerID="cri-o://c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a" gracePeriod=30
Oct 30 07:01:32.284567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.284542    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:32.371191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.371116    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g\" (UniqueName: \"kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g\") pod \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") "
Oct 30 07:01:32.371349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.371252    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file\" (UniqueName: \"kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file\") pod \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\" (UID: \"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da\") "
Oct 30 07:01:32.371602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.371580    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file" pod "a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" (UID: "a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:01:32.373356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.373336    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g" pod "a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" (UID: "a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da"). InnerVolumeSpecName "kube-api-access-tnt5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:01:32.472151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.472120    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnt5g\" (UniqueName: \"kubernetes.io/projected/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-kube-api-access-tnt5g\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:01:32.472151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.472148    5073 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da-config-file\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:01:32.849917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.849886    5073 generic.go:356] "Generic (PLEG): container finished" podID="a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" containerID="c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a" exitCode=0
Oct 30 07:01:32.850113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.849939    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"
Oct 30 07:01:32.850113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.849977    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m" event={"ID":"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da","Type":"ContainerDied","Data":"c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a"}
Oct 30 07:01:32.850113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.850039    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dtr9m" event={"ID":"a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da","Type":"ContainerDied","Data":"1f0f77d440246d740912cfa6dacbedac181eecc643fe46f04e7d4e1e05420639"}
Oct 30 07:01:32.850113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.850071    5073 scope.go:122] "RemoveContainer" containerID="c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a"
Oct 30 07:01:32.865797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.865779    5073 scope.go:122] "RemoveContainer" containerID="c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a"
Oct 30 07:01:32.866061 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:01:32.866042    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a\": container with ID starting with c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a not found: ID does not exist" containerID="c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a"
Oct 30 07:01:32.866109 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.866071    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a"} err="failed to get container status \"c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a\": rpc error: code = NotFound desc = could not find container \"c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a\": container with ID starting with c0f24b70b15b876d650e7b252fb86733e1f5b7e5d0b9df9095ef4341296ae33a not found: ID does not exist"
Oct 30 07:01:32.898534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.898514    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:32.902577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:32.902558    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dtr9m"]
Oct 30 07:01:33.419925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:33.419890    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" path="/var/lib/kubelet/pods/a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da/volumes"
Oct 30 07:01:37.454246 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:37.454218    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:01:37.454877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:37.454842    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:01:43.920504 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:01:43.920463    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:01:55.765002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.764927    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d6kxj"]
Oct 30 07:01:55.765359 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.765317    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" containerName="limitador"
Oct 30 07:01:55.765359 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.765330    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" containerName="limitador"
Oct 30 07:01:55.765428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.765392    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0f1f9b0-8e49-4a05-97b6-b3f990fdc4da" containerName="limitador"
Oct 30 07:01:55.769307 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.769289    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:01:55.786927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.786905    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d6kxj"]
Oct 30 07:01:55.789105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.789088    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fb545\""
Oct 30 07:01:55.866839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.866808    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjwz\" (UniqueName: \"kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz\") pod \"authorino-57f7f8659f-d6kxj\" (UID: \"02d3e675-d3f2-42f5-aa4f-12804cd0441a\") " pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:01:55.968309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.968273    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjwz\" (UniqueName: \"kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz\") pod \"authorino-57f7f8659f-d6kxj\" (UID: \"02d3e675-d3f2-42f5-aa4f-12804cd0441a\") " pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:01:55.991023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:55.990989    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjwz\" (UniqueName: \"kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz\") pod \"authorino-57f7f8659f-d6kxj\" (UID: \"02d3e675-d3f2-42f5-aa4f-12804cd0441a\") " pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:01:56.106128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.106050    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:01:56.293634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.293599    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-hbgck"]
Oct 30 07:01:56.297743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.297722    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:01:56.314640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.314616    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-hbgck"]
Oct 30 07:01:56.404126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.404095    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d6kxj"]
Oct 30 07:01:56.405650 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:01:56.405625    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02d3e675_d3f2_42f5_aa4f_12804cd0441a.slice/crio-adbb56cd451a8d675b45a58e78b6177cb3edbe4db02d87e10448fdb920fb2e47 WatchSource:0}: Error finding container adbb56cd451a8d675b45a58e78b6177cb3edbe4db02d87e10448fdb920fb2e47: Status 404 returned error can't find the container with id adbb56cd451a8d675b45a58e78b6177cb3edbe4db02d87e10448fdb920fb2e47
Oct 30 07:01:56.407013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.406996    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:01:56.472611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.472575    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchkz\" (UniqueName: \"kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz\") pod \"authorino-56c6c9ddd5-hbgck\" (UID: \"3baac2ab-e845-450f-8e11-3844bffa5375\") " pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:01:56.573331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.573298    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchkz\" (UniqueName: \"kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz\") pod \"authorino-56c6c9ddd5-hbgck\" (UID: \"3baac2ab-e845-450f-8e11-3844bffa5375\") " pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:01:56.595904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.595875    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchkz\" (UniqueName: \"kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz\") pod \"authorino-56c6c9ddd5-hbgck\" (UID: \"3baac2ab-e845-450f-8e11-3844bffa5375\") " pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:01:56.610594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.610571    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:01:56.906975 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.906922    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-hbgck"]
Oct 30 07:01:56.907810 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:01:56.907784    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3baac2ab_e845_450f_8e11_3844bffa5375.slice/crio-af578b360361693c68efb9314af28c07e096fca7b7ce72fbe8c87f2486c6341a WatchSource:0}: Error finding container af578b360361693c68efb9314af28c07e096fca7b7ce72fbe8c87f2486c6341a: Status 404 returned error can't find the container with id af578b360361693c68efb9314af28c07e096fca7b7ce72fbe8c87f2486c6341a
Oct 30 07:01:56.958404 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.958371    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d6kxj" event={"ID":"02d3e675-d3f2-42f5-aa4f-12804cd0441a","Type":"ContainerStarted","Data":"adbb56cd451a8d675b45a58e78b6177cb3edbe4db02d87e10448fdb920fb2e47"}
Oct 30 07:01:56.959513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:56.959486    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck" event={"ID":"3baac2ab-e845-450f-8e11-3844bffa5375","Type":"ContainerStarted","Data":"af578b360361693c68efb9314af28c07e096fca7b7ce72fbe8c87f2486c6341a"}
Oct 30 07:01:58.970863 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:58.970807    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d6kxj" event={"ID":"02d3e675-d3f2-42f5-aa4f-12804cd0441a","Type":"ContainerStarted","Data":"bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d"}
Oct 30 07:01:58.972266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:58.972234    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck" event={"ID":"3baac2ab-e845-450f-8e11-3844bffa5375","Type":"ContainerStarted","Data":"b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784"}
Oct 30 07:01:59.008469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:59.008425    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-d6kxj" podStartSLOduration=2.069221956 podStartE2EDuration="4.008410284s" totalImagesPullingTime="1.939188328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:01:59.007754974 +0000 UTC m=+321.715635143" watchObservedRunningTime="2026-10-30 07:01:59.008410284 +0000 UTC m=+321.716290454"
Oct 30 07:01:59.045550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:59.045499    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck" podStartSLOduration=1.4561753130000001 podStartE2EDuration="3.045482983s" totalImagesPullingTime="1.58930767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:01:59.04432382 +0000 UTC m=+321.752203988" watchObservedRunningTime="2026-10-30 07:01:59.045482983 +0000 UTC m=+321.753363154"
Oct 30 07:01:59.076230 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:01:59.076192    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d6kxj"]
Oct 30 07:02:00.982207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:00.982164    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-d6kxj" podUID="02d3e675-d3f2-42f5-aa4f-12804cd0441a" containerName="authorino" containerID="cri-o://bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d" gracePeriod=30
Oct 30 07:02:01.234216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.234159    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:02:01.415347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.415315    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz\" (UniqueName: \"kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz\") pod \"02d3e675-d3f2-42f5-aa4f-12804cd0441a\" (UID: \"02d3e675-d3f2-42f5-aa4f-12804cd0441a\") "
Oct 30 07:02:01.417654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.417625    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz" pod "02d3e675-d3f2-42f5-aa4f-12804cd0441a" (UID: "02d3e675-d3f2-42f5-aa4f-12804cd0441a"). InnerVolumeSpecName "kube-api-access-lhjwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:02:01.516346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.516263    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhjwz\" (UniqueName: \"kubernetes.io/projected/02d3e675-d3f2-42f5-aa4f-12804cd0441a-kube-api-access-lhjwz\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:02:01.988121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.988087    5073 generic.go:356] "Generic (PLEG): container finished" podID="02d3e675-d3f2-42f5-aa4f-12804cd0441a" containerID="bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d" exitCode=0
Oct 30 07:02:01.988535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.988136    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d6kxj"
Oct 30 07:02:01.988535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.988177    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d6kxj" event={"ID":"02d3e675-d3f2-42f5-aa4f-12804cd0441a","Type":"ContainerDied","Data":"bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d"}
Oct 30 07:02:01.988535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.988224    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d6kxj" event={"ID":"02d3e675-d3f2-42f5-aa4f-12804cd0441a","Type":"ContainerDied","Data":"adbb56cd451a8d675b45a58e78b6177cb3edbe4db02d87e10448fdb920fb2e47"}
Oct 30 07:02:01.988535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.988247    5073 scope.go:122] "RemoveContainer" containerID="bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d"
Oct 30 07:02:01.996996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.996977    5073 scope.go:122] "RemoveContainer" containerID="bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d"
Oct 30 07:02:01.997252 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:02:01.997233    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d\": container with ID starting with bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d not found: ID does not exist" containerID="bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d"
Oct 30 07:02:01.997303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:01.997262    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d"} err="failed to get container status \"bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d\": rpc error: code = NotFound desc = could not find container \"bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d\": container with ID starting with bae0a77a60dcc4061782fd17884d5d27c5d0ecfd7922482664928f7ed1a36b7d not found: ID does not exist"
Oct 30 07:02:02.036739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.036708    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d6kxj"]
Oct 30 07:02:02.048253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.048222    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d6kxj"]
Oct 30 07:02:02.189424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.189393    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"]
Oct 30 07:02:02.189759 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.189747    5073 cpu_manager.go:414] "containerMap: removing container" podUID="02d3e675-d3f2-42f5-aa4f-12804cd0441a" containerName="authorino"
Oct 30 07:02:02.189801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.189760    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02d3e675-d3f2-42f5-aa4f-12804cd0441a" containerName="authorino"
Oct 30 07:02:02.189848 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.189839    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="02d3e675-d3f2-42f5-aa4f-12804cd0441a" containerName="authorino"
Oct 30 07:02:02.194116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.194096    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.209277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.209256    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-w6q2z\""
Oct 30 07:02:02.211689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.211669    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 07:02:02.212240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.212224    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 07:02:02.212413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.212396    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 07:02:02.213990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.213971    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"]
Oct 30 07:02:02.323434 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.323346    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j642q\" (UniqueName: \"kubernetes.io/projected/9404344b-23fc-4236-b354-95b0d8b94e04-kube-api-access-j642q\") pod \"postgres-7cdbf6dc44-824tj\" (UID: \"9404344b-23fc-4236-b354-95b0d8b94e04\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.323434 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.323386    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9404344b-23fc-4236-b354-95b0d8b94e04-data\") pod \"postgres-7cdbf6dc44-824tj\" (UID: \"9404344b-23fc-4236-b354-95b0d8b94e04\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.424312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.424270    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j642q\" (UniqueName: \"kubernetes.io/projected/9404344b-23fc-4236-b354-95b0d8b94e04-kube-api-access-j642q\") pod \"postgres-7cdbf6dc44-824tj\" (UID: \"9404344b-23fc-4236-b354-95b0d8b94e04\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.424312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.424313    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9404344b-23fc-4236-b354-95b0d8b94e04-data\") pod \"postgres-7cdbf6dc44-824tj\" (UID: \"9404344b-23fc-4236-b354-95b0d8b94e04\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.424693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.424674    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9404344b-23fc-4236-b354-95b0d8b94e04-data\") pod \"postgres-7cdbf6dc44-824tj\" (UID: \"9404344b-23fc-4236-b354-95b0d8b94e04\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.447151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.447117    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j642q\" (UniqueName: \"kubernetes.io/projected/9404344b-23fc-4236-b354-95b0d8b94e04-kube-api-access-j642q\") pod \"postgres-7cdbf6dc44-824tj\" (UID: \"9404344b-23fc-4236-b354-95b0d8b94e04\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.506068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.506017    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:02.803055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.803024    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"]
Oct 30 07:02:02.803968 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:02:02.803947    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9404344b_23fc_4236_b354_95b0d8b94e04.slice/crio-b40c89f8170b0a2b7550020d5f9606e429e196396f5120c5c8caa60350009e52 WatchSource:0}: Error finding container b40c89f8170b0a2b7550020d5f9606e429e196396f5120c5c8caa60350009e52: Status 404 returned error can't find the container with id b40c89f8170b0a2b7550020d5f9606e429e196396f5120c5c8caa60350009e52
Oct 30 07:02:02.994741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:02.994698    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj" event={"ID":"9404344b-23fc-4236-b354-95b0d8b94e04","Type":"ContainerStarted","Data":"b40c89f8170b0a2b7550020d5f9606e429e196396f5120c5c8caa60350009e52"}
Oct 30 07:02:03.420119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:03.420088    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02d3e675-d3f2-42f5-aa4f-12804cd0441a" path="/var/lib/kubelet/pods/02d3e675-d3f2-42f5-aa4f-12804cd0441a/volumes"
Oct 30 07:02:08.032403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:08.032350    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj" event={"ID":"9404344b-23fc-4236-b354-95b0d8b94e04","Type":"ContainerStarted","Data":"2ae65fdf7a4df8fcc6f54a951b786386e25535dbf8d79d223cd0e2b6a61d4b85"}
Oct 30 07:02:08.032886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:08.032436    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:08.071840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:08.071783    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj" podStartSLOduration=1.333743887 podStartE2EDuration="6.071766264s" totalImagesPullingTime="4.738022377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:02:08.070571641 +0000 UTC m=+330.778451811" watchObservedRunningTime="2026-10-30 07:02:08.071766264 +0000 UTC m=+330.779646434"
Oct 30 07:02:13.919655 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:02:13.919621    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:02:14.066008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:14.065979    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-824tj"
Oct 30 07:02:18.711886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.711843    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-f8dq9"]
Oct 30 07:02:18.715262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.715241    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.740822 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.740799    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 07:02:18.740977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.740933    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4bzxv\""
Oct 30 07:02:18.741028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.740997    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 07:02:18.741215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.741193    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 07:02:18.742949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.742929    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-f8dq9"]
Oct 30 07:02:18.792979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.792947    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82aa31d-bbaf-46d6-8a5c-c8a89db856e5-cert\") pod \"kserve-controller-manager-776cc66d47-f8dq9\" (UID: \"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.793172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.792996    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwwsw\" (UniqueName: \"kubernetes.io/projected/e82aa31d-bbaf-46d6-8a5c-c8a89db856e5-kube-api-access-kwwsw\") pod \"kserve-controller-manager-776cc66d47-f8dq9\" (UID: \"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.805978 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.805192    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-bvqnf"]
Oct 30 07:02:18.810587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.810563    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:18.826916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.826884    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-bvqnf"]
Oct 30 07:02:18.829931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.829910    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 07:02:18.830047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.829926    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wd78g\""
Oct 30 07:02:18.849169 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.849144    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-zw8zl"]
Oct 30 07:02:18.852624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.852603    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.873239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.873214    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-zw8zl"]
Oct 30 07:02:18.893903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.893842    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82aa31d-bbaf-46d6-8a5c-c8a89db856e5-cert\") pod \"kserve-controller-manager-776cc66d47-f8dq9\" (UID: \"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.894054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.893930    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxnm\" (UniqueName: \"kubernetes.io/projected/d108dffa-e8c2-449f-bd16-cf71ec233d84-kube-api-access-cbxnm\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.894054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.893966    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xn6d\" (UniqueName: \"kubernetes.io/projected/ae0aa6ff-7aed-4a46-ae38-2c6618821fec-kube-api-access-5xn6d\") pod \"model-serving-api-75bd89fdfc-bvqnf\" (UID: \"ae0aa6ff-7aed-4a46-ae38-2c6618821fec\") " pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:18.894054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.893992    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d108dffa-e8c2-449f-bd16-cf71ec233d84-cert\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.894231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.894156    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwwsw\" (UniqueName: \"kubernetes.io/projected/e82aa31d-bbaf-46d6-8a5c-c8a89db856e5-kube-api-access-kwwsw\") pod \"kserve-controller-manager-776cc66d47-f8dq9\" (UID: \"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.894285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.894238    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d108dffa-e8c2-449f-bd16-cf71ec233d84-metrics-certs\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.894347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.894296    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae0aa6ff-7aed-4a46-ae38-2c6618821fec-tls-certs\") pod \"model-serving-api-75bd89fdfc-bvqnf\" (UID: \"ae0aa6ff-7aed-4a46-ae38-2c6618821fec\") " pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:18.896483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.896453    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82aa31d-bbaf-46d6-8a5c-c8a89db856e5-cert\") pod \"kserve-controller-manager-776cc66d47-f8dq9\" (UID: \"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.916480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.916452    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwwsw\" (UniqueName: \"kubernetes.io/projected/e82aa31d-bbaf-46d6-8a5c-c8a89db856e5-kube-api-access-kwwsw\") pod \"kserve-controller-manager-776cc66d47-f8dq9\" (UID: \"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:18.930065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.930044    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l8v4p\""
Oct 30 07:02:18.930260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.930243    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 07:02:18.930316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.930299    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 07:02:18.995586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.995531    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d108dffa-e8c2-449f-bd16-cf71ec233d84-metrics-certs\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.995586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.995572    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae0aa6ff-7aed-4a46-ae38-2c6618821fec-tls-certs\") pod \"model-serving-api-75bd89fdfc-bvqnf\" (UID: \"ae0aa6ff-7aed-4a46-ae38-2c6618821fec\") " pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:18.995745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.995614    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxnm\" (UniqueName: \"kubernetes.io/projected/d108dffa-e8c2-449f-bd16-cf71ec233d84-kube-api-access-cbxnm\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.995745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.995632    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xn6d\" (UniqueName: \"kubernetes.io/projected/ae0aa6ff-7aed-4a46-ae38-2c6618821fec-kube-api-access-5xn6d\") pod \"model-serving-api-75bd89fdfc-bvqnf\" (UID: \"ae0aa6ff-7aed-4a46-ae38-2c6618821fec\") " pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:18.995745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.995648    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d108dffa-e8c2-449f-bd16-cf71ec233d84-cert\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.997937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.997916    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d108dffa-e8c2-449f-bd16-cf71ec233d84-cert\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.998051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.997968    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d108dffa-e8c2-449f-bd16-cf71ec233d84-metrics-certs\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:18.998051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:18.997969    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae0aa6ff-7aed-4a46-ae38-2c6618821fec-tls-certs\") pod \"model-serving-api-75bd89fdfc-bvqnf\" (UID: \"ae0aa6ff-7aed-4a46-ae38-2c6618821fec\") " pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:19.018192 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.018167    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxnm\" (UniqueName: \"kubernetes.io/projected/d108dffa-e8c2-449f-bd16-cf71ec233d84-kube-api-access-cbxnm\") pod \"odh-model-controller-769875db56-zw8zl\" (UID: \"d108dffa-e8c2-449f-bd16-cf71ec233d84\") " pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:19.018309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.018250    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xn6d\" (UniqueName: \"kubernetes.io/projected/ae0aa6ff-7aed-4a46-ae38-2c6618821fec-kube-api-access-5xn6d\") pod \"model-serving-api-75bd89fdfc-bvqnf\" (UID: \"ae0aa6ff-7aed-4a46-ae38-2c6618821fec\") " pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:19.027983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.027964    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:19.124310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.124282    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:19.165755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.165716    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:19.327355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.327329    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-f8dq9"]
Oct 30 07:02:19.327944 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:02:19.327922    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82aa31d_bbaf_46d6_8a5c_c8a89db856e5.slice/crio-20ce33d2ac973634927cc4d5f80402d66ffa9946f1e036ee2c3b9256367cc764 WatchSource:0}: Error finding container 20ce33d2ac973634927cc4d5f80402d66ffa9946f1e036ee2c3b9256367cc764: Status 404 returned error can't find the container with id 20ce33d2ac973634927cc4d5f80402d66ffa9946f1e036ee2c3b9256367cc764
Oct 30 07:02:19.424684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.424659    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-bvqnf"]
Oct 30 07:02:19.425844 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:02:19.425820    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0aa6ff_7aed_4a46_ae38_2c6618821fec.slice/crio-f1d774546b18645e657c7a40133b2a0d48b5f235c54965096104411b935bc0b9 WatchSource:0}: Error finding container f1d774546b18645e657c7a40133b2a0d48b5f235c54965096104411b935bc0b9: Status 404 returned error can't find the container with id f1d774546b18645e657c7a40133b2a0d48b5f235c54965096104411b935bc0b9
Oct 30 07:02:19.482164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:19.482131    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-zw8zl"]
Oct 30 07:02:19.483775 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:02:19.483749    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd108dffa_e8c2_449f_bd16_cf71ec233d84.slice/crio-ba226f29c0d53aeee27da9010c34b406293568ec706a5bdcc38675b15789a25e WatchSource:0}: Error finding container ba226f29c0d53aeee27da9010c34b406293568ec706a5bdcc38675b15789a25e: Status 404 returned error can't find the container with id ba226f29c0d53aeee27da9010c34b406293568ec706a5bdcc38675b15789a25e
Oct 30 07:02:20.099187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:20.099071    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-zw8zl" event={"ID":"d108dffa-e8c2-449f-bd16-cf71ec233d84","Type":"ContainerStarted","Data":"ba226f29c0d53aeee27da9010c34b406293568ec706a5bdcc38675b15789a25e"}
Oct 30 07:02:20.100701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:20.100674    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf" event={"ID":"ae0aa6ff-7aed-4a46-ae38-2c6618821fec","Type":"ContainerStarted","Data":"f1d774546b18645e657c7a40133b2a0d48b5f235c54965096104411b935bc0b9"}
Oct 30 07:02:20.102407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:20.102327    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9" event={"ID":"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5","Type":"ContainerStarted","Data":"20ce33d2ac973634927cc4d5f80402d66ffa9946f1e036ee2c3b9256367cc764"}
Oct 30 07:02:23.120934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.120892    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf" event={"ID":"ae0aa6ff-7aed-4a46-ae38-2c6618821fec","Type":"ContainerStarted","Data":"b9e3813edc198efb37c98e62b4cd79bbdf0bbda15201a82146870d3a6501d138"}
Oct 30 07:02:23.121385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.121011    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:23.122478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.122450    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9" event={"ID":"e82aa31d-bbaf-46d6-8a5c-c8a89db856e5","Type":"ContainerStarted","Data":"cee520692dca9f440bacbf88789ec83a4dbeb8e9a1a7c6dbd90ce8c95790380b"}
Oct 30 07:02:23.122609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.122494    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:23.124068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.124016    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-zw8zl" event={"ID":"d108dffa-e8c2-449f-bd16-cf71ec233d84","Type":"ContainerStarted","Data":"6a02f723e7d6c3a732bd08902ca94fae831fdbde440003e9a762376acef30fb2"}
Oct 30 07:02:23.124412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.124382    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:23.170188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.170141    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf" podStartSLOduration=2.465529836 podStartE2EDuration="5.170129278s" totalImagesPullingTime="2.704599442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:02:23.168723637 +0000 UTC m=+345.876603808" watchObservedRunningTime="2026-10-30 07:02:23.170129278 +0000 UTC m=+345.878009447"
Oct 30 07:02:23.209759 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.209710    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9" podStartSLOduration=1.5652859380000002 podStartE2EDuration="5.209697771s" totalImagesPullingTime="3.644411833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:02:23.20906102 +0000 UTC m=+345.916941189" watchObservedRunningTime="2026-10-30 07:02:23.209697771 +0000 UTC m=+345.917577939"
Oct 30 07:02:23.251224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:23.251148    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-zw8zl" podStartSLOduration=1.764408742 podStartE2EDuration="5.251135612s" totalImagesPullingTime="3.48672687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:02:23.250327114 +0000 UTC m=+345.958207304" watchObservedRunningTime="2026-10-30 07:02:23.251135612 +0000 UTC m=+345.959015772"
Oct 30 07:02:34.138699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:34.138669    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-bvqnf"
Oct 30 07:02:35.141545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:35.141516    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-zw8zl"
Oct 30 07:02:43.920197 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:02:43.920160    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:02:54.139672 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:54.139638    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-f8dq9"
Oct 30 07:02:59.352478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.352439    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"]
Oct 30 07:02:59.360225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.360199    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.389347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.389324    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lnjcd\""
Oct 30 07:02:59.389347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.389325    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 07:02:59.389347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.389330    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 07:02:59.391312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.391290    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"]
Oct 30 07:02:59.472645 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.472606    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.472810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.472789    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.472943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.472928    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.473000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.472967    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt85r\" (UniqueName: \"kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.574615 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.574580    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.574615 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.574621    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt85r\" (UniqueName: \"kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.574881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.574663    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.574881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.574691    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.575265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.575239    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.577090 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.577067    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.577194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.577175    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.621632 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.621565    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt85r\" (UniqueName: \"kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r\") pod \"maas-api-8b74c94db-9rrcq\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") " pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.673349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.673313    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:02:59.977067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:02:59.977035    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"]
Oct 30 07:02:59.978560 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:02:59.978530    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dc977d_fff6_453e_90ed_bacea6c16744.slice/crio-3a82c272bfc337d4425583c81d62a56bdd99de7f005938f558b78ba7b2d81cd9 WatchSource:0}: Error finding container 3a82c272bfc337d4425583c81d62a56bdd99de7f005938f558b78ba7b2d81cd9: Status 404 returned error can't find the container with id 3a82c272bfc337d4425583c81d62a56bdd99de7f005938f558b78ba7b2d81cd9
Oct 30 07:03:00.295824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:00.295737    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq" event={"ID":"48dc977d-fff6-453e-90ed-bacea6c16744","Type":"ContainerStarted","Data":"3a82c272bfc337d4425583c81d62a56bdd99de7f005938f558b78ba7b2d81cd9"}
Oct 30 07:03:03.313691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:03.313657    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq" event={"ID":"48dc977d-fff6-453e-90ed-bacea6c16744","Type":"ContainerStarted","Data":"b6bafbd5c6632fcea05ee1b6a6acb37e2ba826a80cc3c1974bcef10078315495"}
Oct 30 07:03:03.314235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:03.313770    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:03:03.355300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:03.355245    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq" podStartSLOduration=1.583873331 podStartE2EDuration="4.355228977s" totalImagesPullingTime="2.771355646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:03:03.353474408 +0000 UTC m=+386.061354579" watchObservedRunningTime="2026-10-30 07:03:03.355228977 +0000 UTC m=+386.063109146"
Oct 30 07:03:09.325284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:09.325252    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:03:10.182654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.182620    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-qghv9"]
Oct 30 07:03:10.186387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.186359    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:10.209704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.209671    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-qghv9"]
Oct 30 07:03:10.275915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.275875    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnd9v\" (UniqueName: \"kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v\") pod \"authorino-6f6944bcdd-qghv9\" (UID: \"583174d9-bdc0-44ee-a953-7b0cd6000fe2\") " pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:10.377334 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.377297    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnd9v\" (UniqueName: \"kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v\") pod \"authorino-6f6944bcdd-qghv9\" (UID: \"583174d9-bdc0-44ee-a953-7b0cd6000fe2\") " pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:10.402614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.402582    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnd9v\" (UniqueName: \"kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v\") pod \"authorino-6f6944bcdd-qghv9\" (UID: \"583174d9-bdc0-44ee-a953-7b0cd6000fe2\") " pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:10.461845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.461787    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-qghv9"]
Oct 30 07:03:10.463881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.461993    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:10.488489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.488450    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cnlmx"]
Oct 30 07:03:10.493328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.493307    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.511366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.511335    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cnlmx"]
Oct 30 07:03:10.515993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.515969    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 07:03:10.579572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.579541    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert\") pod \"authorino-6889cbd8c4-cnlmx\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") " pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.579705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.579586    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbb2f\" (UniqueName: \"kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f\") pod \"authorino-6889cbd8c4-cnlmx\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") " pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.579991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.579969    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cnlmx"]
Oct 30 07:03:10.580207 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:03:10.580186    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mbb2f tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-cnlmx" podUID="546bc325-52d4-440b-b06d-e40949bcca05"
Oct 30 07:03:10.605706 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.605676    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f78f8b74-vcmbh"]
Oct 30 07:03:10.609134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.609114    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.627701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.627677    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f78f8b74-vcmbh"]
Oct 30 07:03:10.680363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.680299    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert\") pod \"authorino-6889cbd8c4-cnlmx\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") " pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.680363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.680340    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbb2f\" (UniqueName: \"kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f\") pod \"authorino-6889cbd8c4-cnlmx\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") " pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.680527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.680465    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert\") pod \"authorino-f78f8b74-vcmbh\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") " pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.680527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.680495    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz5tw\" (UniqueName: \"kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw\") pod \"authorino-f78f8b74-vcmbh\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") " pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.682735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.682713    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert\") pod \"authorino-6889cbd8c4-cnlmx\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") " pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.702546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.702526    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbb2f\" (UniqueName: \"kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f\") pod \"authorino-6889cbd8c4-cnlmx\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") " pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:10.761477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.761443    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-qghv9"]
Oct 30 07:03:10.762955 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:03:10.762926    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod583174d9_bdc0_44ee_a953_7b0cd6000fe2.slice/crio-643f56619076b381a76b9dbe83578f0e5dcd7f6735a0488cc83e5ade55870594 WatchSource:0}: Error finding container 643f56619076b381a76b9dbe83578f0e5dcd7f6735a0488cc83e5ade55870594: Status 404 returned error can't find the container with id 643f56619076b381a76b9dbe83578f0e5dcd7f6735a0488cc83e5ade55870594
Oct 30 07:03:10.781509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.781483    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert\") pod \"authorino-f78f8b74-vcmbh\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") " pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.781602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.781513    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz5tw\" (UniqueName: \"kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw\") pod \"authorino-f78f8b74-vcmbh\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") " pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.783843 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.783822    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert\") pod \"authorino-f78f8b74-vcmbh\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") " pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.803213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.803190    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz5tw\" (UniqueName: \"kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw\") pod \"authorino-f78f8b74-vcmbh\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") " pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:10.920512 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:10.920482    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:03:11.215810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.215787    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f78f8b74-vcmbh"]
Oct 30 07:03:11.217336 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:03:11.217309    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd019cca_505f_40d3_8033_75866818aeed.slice/crio-e3e509be24460d2b8c81e8d0469063da9986691ff3be47d85a34f6625ce76830 WatchSource:0}: Error finding container e3e509be24460d2b8c81e8d0469063da9986691ff3be47d85a34f6625ce76830: Status 404 returned error can't find the container with id e3e509be24460d2b8c81e8d0469063da9986691ff3be47d85a34f6625ce76830
Oct 30 07:03:11.360923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.360879    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-qghv9" event={"ID":"583174d9-bdc0-44ee-a953-7b0cd6000fe2","Type":"ContainerStarted","Data":"d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2"}
Oct 30 07:03:11.361094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.360932    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-qghv9" event={"ID":"583174d9-bdc0-44ee-a953-7b0cd6000fe2","Type":"ContainerStarted","Data":"643f56619076b381a76b9dbe83578f0e5dcd7f6735a0488cc83e5ade55870594"}
Oct 30 07:03:11.361094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.360885    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-qghv9" podUID="583174d9-bdc0-44ee-a953-7b0cd6000fe2" containerName="authorino" containerID="cri-o://d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2" gracePeriod=30
Oct 30 07:03:11.364555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.364527    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f78f8b74-vcmbh" event={"ID":"cd019cca-505f-40d3-8033-75866818aeed","Type":"ContainerStarted","Data":"e3e509be24460d2b8c81e8d0469063da9986691ff3be47d85a34f6625ce76830"}
Oct 30 07:03:11.366219 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.366188    5073 generic.go:356] "Generic (PLEG): container finished" podID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerID="f8096f3f50818883409fe58d51e939d05d8088b1ab270b34c5a88cbead995ae8" exitCode=0
Oct 30 07:03:11.366338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.366262    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" event={"ID":"f0f75d92-2523-4dbe-89d0-628ebd8c8690","Type":"ContainerDied","Data":"f8096f3f50818883409fe58d51e939d05d8088b1ab270b34c5a88cbead995ae8"}
Oct 30 07:03:11.366338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.366283    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:11.366666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.366651    5073 scope.go:122] "RemoveContainer" containerID="f8096f3f50818883409fe58d51e939d05d8088b1ab270b34c5a88cbead995ae8"
Oct 30 07:03:11.367719 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.367689    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:03:11.367804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.367752    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:03:11.367804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.367784    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:03:11.373695 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.373676    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:11.398123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.398056    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-qghv9" podStartSLOduration=1.018897792 podStartE2EDuration="1.398040387s" totalImagesPullingTime="379.142595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:03:11.397659707 +0000 UTC m=+394.105539877" watchObservedRunningTime="2026-10-30 07:03:11.398040387 +0000 UTC m=+394.105920557"
Oct 30 07:03:11.488053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.488022    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert\" (UniqueName: \"kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert\") pod \"546bc325-52d4-440b-b06d-e40949bcca05\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") "
Oct 30 07:03:11.488268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.488251    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f\" (UniqueName: \"kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f\") pod \"546bc325-52d4-440b-b06d-e40949bcca05\" (UID: \"546bc325-52d4-440b-b06d-e40949bcca05\") "
Oct 30 07:03:11.493333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.493294    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f" pod "546bc325-52d4-440b-b06d-e40949bcca05" (UID: "546bc325-52d4-440b-b06d-e40949bcca05"). InnerVolumeSpecName "kube-api-access-mbb2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:03:11.493583 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.493553    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert" pod "546bc325-52d4-440b-b06d-e40949bcca05" (UID: "546bc325-52d4-440b-b06d-e40949bcca05"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:03:11.593465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.593407    5073 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/546bc325-52d4-440b-b06d-e40949bcca05-tls-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:11.593465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.593435    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbb2f\" (UniqueName: \"kubernetes.io/projected/546bc325-52d4-440b-b06d-e40949bcca05-kube-api-access-mbb2f\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:11.642876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.642841    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:11.693998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.693971    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v\" (UniqueName: \"kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v\") pod \"583174d9-bdc0-44ee-a953-7b0cd6000fe2\" (UID: \"583174d9-bdc0-44ee-a953-7b0cd6000fe2\") "
Oct 30 07:03:11.696102 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.696062    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v" pod "583174d9-bdc0-44ee-a953-7b0cd6000fe2" (UID: "583174d9-bdc0-44ee-a953-7b0cd6000fe2"). InnerVolumeSpecName "kube-api-access-lnd9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:03:11.794897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:11.794846    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnd9v\" (UniqueName: \"kubernetes.io/projected/583174d9-bdc0-44ee-a953-7b0cd6000fe2-kube-api-access-lnd9v\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:12.382446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.380540    5073 generic.go:356] "Generic (PLEG): container finished" podID="583174d9-bdc0-44ee-a953-7b0cd6000fe2" containerID="d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2" exitCode=0
Oct 30 07:03:12.382446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.380698    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-qghv9" event={"ID":"583174d9-bdc0-44ee-a953-7b0cd6000fe2","Type":"ContainerDied","Data":"d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2"}
Oct 30 07:03:12.382446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.380743    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-qghv9" event={"ID":"583174d9-bdc0-44ee-a953-7b0cd6000fe2","Type":"ContainerDied","Data":"643f56619076b381a76b9dbe83578f0e5dcd7f6735a0488cc83e5ade55870594"}
Oct 30 07:03:12.382446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.380774    5073 scope.go:122] "RemoveContainer" containerID="d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2"
Oct 30 07:03:12.382446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.380954    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-qghv9"
Oct 30 07:03:12.386960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.386543    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f78f8b74-vcmbh" event={"ID":"cd019cca-505f-40d3-8033-75866818aeed","Type":"ContainerStarted","Data":"229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a"}
Oct 30 07:03:12.390889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.390600    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cnlmx"
Oct 30 07:03:12.393042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.392424    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" event={"ID":"f0f75d92-2523-4dbe-89d0-628ebd8c8690","Type":"ContainerStarted","Data":"061ee7a1721b4efabb1065ba9831ebc11d82ae4ce72de0d794f020dd677b46d0"}
Oct 30 07:03:12.408476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.408448    5073 scope.go:122] "RemoveContainer" containerID="d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2"
Oct 30 07:03:12.408971 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:03:12.408930    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2\": container with ID starting with d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2 not found: ID does not exist" containerID="d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2"
Oct 30 07:03:12.409034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.408990    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2"} err="failed to get container status \"d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2\": rpc error: code = NotFound desc = could not find container \"d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2\": container with ID starting with d60ff3732cc904992ab5bc0b86556aedf1193a821bf80e74385d829af01ad4a2 not found: ID does not exist"
Oct 30 07:03:12.446772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.443151    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:03:12.447116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.447085    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 07:03:12.447199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.447146    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 07:03:12.497946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.497912    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:03:12.550290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.550239    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-f78f8b74-vcmbh" podStartSLOduration=2.175646547 podStartE2EDuration="2.550223684s" totalImagesPullingTime="374.577137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:03:12.5240601 +0000 UTC m=+395.231940270" watchObservedRunningTime="2026-10-30 07:03:12.550223684 +0000 UTC m=+395.258103852"
Oct 30 07:03:12.550504 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.550489    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-hbgck"]
Oct 30 07:03:12.550654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.550636    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck" podUID="3baac2ab-e845-450f-8e11-3844bffa5375" containerName="authorino" containerID="cri-o://b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784" gracePeriod=30
Oct 30 07:03:12.607877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.606974    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cnlmx"]
Oct 30 07:03:12.609242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.609197    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cnlmx"]
Oct 30 07:03:12.637882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.637786    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-qghv9"]
Oct 30 07:03:12.643050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.643022    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-qghv9"]
Oct 30 07:03:12.909172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:12.909103    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:03:13.018253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.018219    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz\" (UniqueName: \"kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz\") pod \"3baac2ab-e845-450f-8e11-3844bffa5375\" (UID: \"3baac2ab-e845-450f-8e11-3844bffa5375\") "
Oct 30 07:03:13.020288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.020265    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz" pod "3baac2ab-e845-450f-8e11-3844bffa5375" (UID: "3baac2ab-e845-450f-8e11-3844bffa5375"). InnerVolumeSpecName "kube-api-access-dchkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:03:13.119443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.119402    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dchkz\" (UniqueName: \"kubernetes.io/projected/3baac2ab-e845-450f-8e11-3844bffa5375-kube-api-access-dchkz\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:13.401498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.401468    5073 generic.go:356] "Generic (PLEG): container finished" podID="3baac2ab-e845-450f-8e11-3844bffa5375" containerID="b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784" exitCode=0
Oct 30 07:03:13.401692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.401518    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck"
Oct 30 07:03:13.401692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.401565    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck" event={"ID":"3baac2ab-e845-450f-8e11-3844bffa5375","Type":"ContainerDied","Data":"b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784"}
Oct 30 07:03:13.401692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.401604    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-hbgck" event={"ID":"3baac2ab-e845-450f-8e11-3844bffa5375","Type":"ContainerDied","Data":"af578b360361693c68efb9314af28c07e096fca7b7ce72fbe8c87f2486c6341a"}
Oct 30 07:03:13.401692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.401621    5073 scope.go:122] "RemoveContainer" containerID="b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784"
Oct 30 07:03:13.410546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.410528    5073 scope.go:122] "RemoveContainer" containerID="b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784"
Oct 30 07:03:13.410803 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:03:13.410791    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784\": container with ID starting with b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784 not found: ID does not exist" containerID="b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784"
Oct 30 07:03:13.410842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.410813    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784"} err="failed to get container status \"b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784\": rpc error: code = NotFound desc = could not find container \"b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784\": container with ID starting with b90b2deede5dc1a9bfc0e7ec687a481a19292c41a49a6518f6c46640d8b38784 not found: ID does not exist"
Oct 30 07:03:13.419994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.419975    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="546bc325-52d4-440b-b06d-e40949bcca05" path="/var/lib/kubelet/pods/546bc325-52d4-440b-b06d-e40949bcca05/volumes"
Oct 30 07:03:13.420206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.420195    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="583174d9-bdc0-44ee-a953-7b0cd6000fe2" path="/var/lib/kubelet/pods/583174d9-bdc0-44ee-a953-7b0cd6000fe2/volumes"
Oct 30 07:03:13.438468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.438448    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 07:03:13.438552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.438489    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 07:03:13.452145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.452122    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-hbgck"]
Oct 30 07:03:13.455982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:13.455961    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-hbgck"]
Oct 30 07:03:13.922272 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:03:13.922238    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:03:14.438512 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:14.438481    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 07:03:14.438949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:14.438533    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 07:03:15.419614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:15.419571    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3baac2ab-e845-450f-8e11-3844bffa5375" path="/var/lib/kubelet/pods/3baac2ab-e845-450f-8e11-3844bffa5375/volumes"
Oct 30 07:03:15.437924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:15.437897    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 07:03:15.438028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:15.437946    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 07:03:16.437787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:16.437756    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 07:03:16.438231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:16.437806    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 07:03:17.438246 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:17.438209    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Oct 30 07:03:17.438621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:17.438262    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Oct 30 07:03:18.441720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:18.441689    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:03:18.442550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:18.442531    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx"
Oct 30 07:03:20.319826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.319789    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"]
Oct 30 07:03:20.320261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.320012    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq" podUID="48dc977d-fff6-453e-90ed-bacea6c16744" containerName="maas-api" containerID="cri-o://b6bafbd5c6632fcea05ee1b6a6acb37e2ba826a80cc3c1974bcef10078315495" gracePeriod=30
Oct 30 07:03:20.437760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.437707    5073 generic.go:356] "Generic (PLEG): container finished" podID="48dc977d-fff6-453e-90ed-bacea6c16744" containerID="b6bafbd5c6632fcea05ee1b6a6acb37e2ba826a80cc3c1974bcef10078315495" exitCode=0
Oct 30 07:03:20.437812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.437774    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq" event={"ID":"48dc977d-fff6-453e-90ed-bacea6c16744","Type":"ContainerDied","Data":"b6bafbd5c6632fcea05ee1b6a6acb37e2ba826a80cc3c1974bcef10078315495"}
Oct 30 07:03:20.564745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.564724    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:03:20.686691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.686658    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs\") pod \"48dc977d-fff6-453e-90ed-bacea6c16744\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") "
Oct 30 07:03:20.686845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.686697    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca\") pod \"48dc977d-fff6-453e-90ed-bacea6c16744\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") "
Oct 30 07:03:20.686845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.686811    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r\" (UniqueName: \"kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r\") pod \"48dc977d-fff6-453e-90ed-bacea6c16744\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") "
Oct 30 07:03:20.686953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.686847    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls\") pod \"48dc977d-fff6-453e-90ed-bacea6c16744\" (UID: \"48dc977d-fff6-453e-90ed-bacea6c16744\") "
Oct 30 07:03:20.687175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.687141    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca" pod "48dc977d-fff6-453e-90ed-bacea6c16744" (UID: "48dc977d-fff6-453e-90ed-bacea6c16744"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:03:20.689011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.688985    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs" pod "48dc977d-fff6-453e-90ed-bacea6c16744" (UID: "48dc977d-fff6-453e-90ed-bacea6c16744"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:03:20.689011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.688997    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r" pod "48dc977d-fff6-453e-90ed-bacea6c16744" (UID: "48dc977d-fff6-453e-90ed-bacea6c16744"). InnerVolumeSpecName "kube-api-access-bt85r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:03:20.689134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.689059    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls" pod "48dc977d-fff6-453e-90ed-bacea6c16744" (UID: "48dc977d-fff6-453e-90ed-bacea6c16744"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:03:20.787584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.787558    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt85r\" (UniqueName: \"kubernetes.io/projected/48dc977d-fff6-453e-90ed-bacea6c16744-kube-api-access-bt85r\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:20.787584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.787581    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:20.787584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.787590    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48dc977d-fff6-453e-90ed-bacea6c16744-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:20.787770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:20.787598    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc977d-fff6-453e-90ed-bacea6c16744-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:03:21.443628 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:21.443600    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"
Oct 30 07:03:21.444042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:21.443644    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq" event={"ID":"48dc977d-fff6-453e-90ed-bacea6c16744","Type":"ContainerDied","Data":"3a82c272bfc337d4425583c81d62a56bdd99de7f005938f558b78ba7b2d81cd9"}
Oct 30 07:03:21.444042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:21.443702    5073 scope.go:122] "RemoveContainer" containerID="b6bafbd5c6632fcea05ee1b6a6acb37e2ba826a80cc3c1974bcef10078315495"
Oct 30 07:03:21.492540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:21.492516    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"]
Oct 30 07:03:21.503844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:21.503823    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b74c94db-9rrcq"]
Oct 30 07:03:23.420867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:23.420814    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48dc977d-fff6-453e-90ed-bacea6c16744" path="/var/lib/kubelet/pods/48dc977d-fff6-453e-90ed-bacea6c16744/volumes"
Oct 30 07:03:37.446569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:03:37.446539    5073 scope.go:122] "RemoveContainer" containerID="54ba1d9e59cc10b5e35b63e3eeb78e11b34ee3dd7b29ba25579d8d816a90bc45"
Oct 30 07:03:43.920958 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:03:43.920916    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:04:07.815828 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.815794    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-m8kq8"]
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816191    5073 cpu_manager.go:414] "containerMap: removing container" podUID="3baac2ab-e845-450f-8e11-3844bffa5375" containerName="authorino"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816202    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3baac2ab-e845-450f-8e11-3844bffa5375" containerName="authorino"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816218    5073 cpu_manager.go:414] "containerMap: removing container" podUID="583174d9-bdc0-44ee-a953-7b0cd6000fe2" containerName="authorino"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816222    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="583174d9-bdc0-44ee-a953-7b0cd6000fe2" containerName="authorino"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816237    5073 cpu_manager.go:414] "containerMap: removing container" podUID="48dc977d-fff6-453e-90ed-bacea6c16744" containerName="maas-api"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816242    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48dc977d-fff6-453e-90ed-bacea6c16744" containerName="maas-api"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816300    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="3baac2ab-e845-450f-8e11-3844bffa5375" containerName="authorino"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816308    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="583174d9-bdc0-44ee-a953-7b0cd6000fe2" containerName="authorino"
Oct 30 07:04:07.816325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.816314    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="48dc977d-fff6-453e-90ed-bacea6c16744" containerName="maas-api"
Oct 30 07:04:07.819596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.819580    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:07.843136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.843112    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-m8kq8"]
Oct 30 07:04:07.848530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.848508    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 07:04:07.848705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.848579    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 07:04:07.848705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.848693    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-ggpk5\""
Oct 30 07:04:07.866445 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.866416    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-m8kq8\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") " pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:07.866549 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.866478    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltdv\" (UniqueName: \"kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv\") pod \"ai-gateway-controller-7d85675f98-m8kq8\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") " pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:07.967940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.967905    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-m8kq8\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") " pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:07.968105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.968038    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wltdv\" (UniqueName: \"kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv\") pod \"ai-gateway-controller-7d85675f98-m8kq8\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") " pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:07.970634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.970604    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-m8kq8\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") " pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:07.990502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:07.990479    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltdv\" (UniqueName: \"kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv\") pod \"ai-gateway-controller-7d85675f98-m8kq8\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") " pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:08.132220 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:08.132186    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:08.428240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:08.428212    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-m8kq8"]
Oct 30 07:04:08.429832 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:08.429806    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6ec1b2_c058_43b1_991c_d6e69913ef4b.slice/crio-d5a432e9578ff6bb746b92c2f20cff32472cc3b24bc263109b2765082abbabf3 WatchSource:0}: Error finding container d5a432e9578ff6bb746b92c2f20cff32472cc3b24bc263109b2765082abbabf3: Status 404 returned error can't find the container with id d5a432e9578ff6bb746b92c2f20cff32472cc3b24bc263109b2765082abbabf3
Oct 30 07:04:08.660743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:08.660708    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8" event={"ID":"8d6ec1b2-c058-43b1-991c-d6e69913ef4b","Type":"ContainerStarted","Data":"d5a432e9578ff6bb746b92c2f20cff32472cc3b24bc263109b2765082abbabf3"}
Oct 30 07:04:10.671588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:10.671536    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8" event={"ID":"8d6ec1b2-c058-43b1-991c-d6e69913ef4b","Type":"ContainerStarted","Data":"78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44"}
Oct 30 07:04:10.671981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:10.671692    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:10.711895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:10.711831    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8" podStartSLOduration=2.252320547 podStartE2EDuration="3.711818837s" totalImagesPullingTime="1.45949829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:10.710529699 +0000 UTC m=+453.418409869" watchObservedRunningTime="2026-10-30 07:04:10.711818837 +0000 UTC m=+453.419699005"
Oct 30 07:04:12.284727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.284689    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"]
Oct 30 07:04:12.288424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.288406    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.337701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.337671    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 07:04:12.337701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.337669    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nv49b\""
Oct 30 07:04:12.339408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.339384    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"]
Oct 30 07:04:12.376471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.376434    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-8r9sh"]
Oct 30 07:04:12.380314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.380290    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.401618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.401586    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-8r9sh"]
Oct 30 07:04:12.409087 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.409049    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040eb592-bd9f-4293-9525-703635e87f32-plugins-config-volume\") pod \"payload-processing-5f78687d5b-8r9sh\" (UID: \"040eb592-bd9f-4293-9525-703635e87f32\") " pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.409266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.409103    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrjb\" (UniqueName: \"kubernetes.io/projected/b714de5b-3cba-4cd2-ae2d-b371fdde9cf0-kube-api-access-wtrjb\") pod \"payload-pre-processing-7b98bb678c-fcr4n\" (UID: \"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.409266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.409176    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rxck\" (UniqueName: \"kubernetes.io/projected/040eb592-bd9f-4293-9525-703635e87f32-kube-api-access-6rxck\") pod \"payload-processing-5f78687d5b-8r9sh\" (UID: \"040eb592-bd9f-4293-9525-703635e87f32\") " pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.409266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.409239    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b714de5b-3cba-4cd2-ae2d-b371fdde9cf0-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-fcr4n\" (UID: \"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.510451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.510414    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040eb592-bd9f-4293-9525-703635e87f32-plugins-config-volume\") pod \"payload-processing-5f78687d5b-8r9sh\" (UID: \"040eb592-bd9f-4293-9525-703635e87f32\") " pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.510654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.510483    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrjb\" (UniqueName: \"kubernetes.io/projected/b714de5b-3cba-4cd2-ae2d-b371fdde9cf0-kube-api-access-wtrjb\") pod \"payload-pre-processing-7b98bb678c-fcr4n\" (UID: \"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.510654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.510528    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rxck\" (UniqueName: \"kubernetes.io/projected/040eb592-bd9f-4293-9525-703635e87f32-kube-api-access-6rxck\") pod \"payload-processing-5f78687d5b-8r9sh\" (UID: \"040eb592-bd9f-4293-9525-703635e87f32\") " pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.510654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.510561    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b714de5b-3cba-4cd2-ae2d-b371fdde9cf0-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-fcr4n\" (UID: \"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.511401 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.511374    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b714de5b-3cba-4cd2-ae2d-b371fdde9cf0-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-fcr4n\" (UID: \"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.511510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.511493    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/040eb592-bd9f-4293-9525-703635e87f32-plugins-config-volume\") pod \"payload-processing-5f78687d5b-8r9sh\" (UID: \"040eb592-bd9f-4293-9525-703635e87f32\") " pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.533345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.533316    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rxck\" (UniqueName: \"kubernetes.io/projected/040eb592-bd9f-4293-9525-703635e87f32-kube-api-access-6rxck\") pod \"payload-processing-5f78687d5b-8r9sh\" (UID: \"040eb592-bd9f-4293-9525-703635e87f32\") " pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.533470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.533372    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrjb\" (UniqueName: \"kubernetes.io/projected/b714de5b-3cba-4cd2-ae2d-b371fdde9cf0-kube-api-access-wtrjb\") pod \"payload-pre-processing-7b98bb678c-fcr4n\" (UID: \"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.601299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.601227    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:12.692913 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.692882    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:12.898465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.898439    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"]
Oct 30 07:04:12.899937 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:12.899909    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb714de5b_3cba_4cd2_ae2d_b371fdde9cf0.slice/crio-ffafb2896aee7f0a435218494cba6d96f7d3f74780615a43322efcbab7211cfa WatchSource:0}: Error finding container ffafb2896aee7f0a435218494cba6d96f7d3f74780615a43322efcbab7211cfa: Status 404 returned error can't find the container with id ffafb2896aee7f0a435218494cba6d96f7d3f74780615a43322efcbab7211cfa
Oct 30 07:04:12.993293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:12.993266    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-8r9sh"]
Oct 30 07:04:12.994187 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:12.994160    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040eb592_bd9f_4293_9525_703635e87f32.slice/crio-06f79d56227c6db3805b0e5a2fb94ffe2f8ae2577e824ff82162945c95cf3c17 WatchSource:0}: Error finding container 06f79d56227c6db3805b0e5a2fb94ffe2f8ae2577e824ff82162945c95cf3c17: Status 404 returned error can't find the container with id 06f79d56227c6db3805b0e5a2fb94ffe2f8ae2577e824ff82162945c95cf3c17
Oct 30 07:04:13.692510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:13.692419    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh" event={"ID":"040eb592-bd9f-4293-9525-703635e87f32","Type":"ContainerStarted","Data":"06f79d56227c6db3805b0e5a2fb94ffe2f8ae2577e824ff82162945c95cf3c17"}
Oct 30 07:04:13.695241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:13.695206    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n" event={"ID":"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0","Type":"ContainerStarted","Data":"ffafb2896aee7f0a435218494cba6d96f7d3f74780615a43322efcbab7211cfa"}
Oct 30 07:04:13.933320 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:04:13.933279    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:04:15.709328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:15.709283    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh" event={"ID":"040eb592-bd9f-4293-9525-703635e87f32","Type":"ContainerStarted","Data":"d297b1e8020aadabf0bfd9889a11376070e4ed97d305d67293bd4129d0232af1"}
Oct 30 07:04:15.709751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:15.709385    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:15.710844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:15.710816    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n" event={"ID":"b714de5b-3cba-4cd2-ae2d-b371fdde9cf0","Type":"ContainerStarted","Data":"8c7067c78c16972e5fafe99025514c728b2797eb40387312a362b59199e39a4b"}
Oct 30 07:04:15.710984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:15.710891    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:15.749671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:15.749626    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh" podStartSLOduration=1.402254896 podStartE2EDuration="3.749614606s" totalImagesPullingTime="2.34735971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:15.748083037 +0000 UTC m=+458.455963206" watchObservedRunningTime="2026-10-30 07:04:15.749614606 +0000 UTC m=+458.457494774"
Oct 30 07:04:15.787864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:15.787816    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n" podStartSLOduration=1.263501876 podStartE2EDuration="3.787803887s" totalImagesPullingTime="2.524302011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:15.786255009 +0000 UTC m=+458.494135177" watchObservedRunningTime="2026-10-30 07:04:15.787803887 +0000 UTC m=+458.495684060"
Oct 30 07:04:21.679136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:21.679104    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:21.970860 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:21.970774    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"]
Oct 30 07:04:21.974466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:21.974447    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:21.994714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:21.994691    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"]
Oct 30 07:04:22.098596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.098553    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6c0df3a-03bb-4854-8648-d00495b75313-metrics-certs\") pod \"ai-gateway-controller-55c8cc7799-jxvjj\" (UID: \"c6c0df3a-03bb-4854-8648-d00495b75313\") " pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.098754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.098596    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2gd\" (UniqueName: \"kubernetes.io/projected/c6c0df3a-03bb-4854-8648-d00495b75313-kube-api-access-xb2gd\") pod \"ai-gateway-controller-55c8cc7799-jxvjj\" (UID: \"c6c0df3a-03bb-4854-8648-d00495b75313\") " pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.199870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.199824    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6c0df3a-03bb-4854-8648-d00495b75313-metrics-certs\") pod \"ai-gateway-controller-55c8cc7799-jxvjj\" (UID: \"c6c0df3a-03bb-4854-8648-d00495b75313\") " pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.200022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.199877    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2gd\" (UniqueName: \"kubernetes.io/projected/c6c0df3a-03bb-4854-8648-d00495b75313-kube-api-access-xb2gd\") pod \"ai-gateway-controller-55c8cc7799-jxvjj\" (UID: \"c6c0df3a-03bb-4854-8648-d00495b75313\") " pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.202122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.202095    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6c0df3a-03bb-4854-8648-d00495b75313-metrics-certs\") pod \"ai-gateway-controller-55c8cc7799-jxvjj\" (UID: \"c6c0df3a-03bb-4854-8648-d00495b75313\") " pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.222527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.222471    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2gd\" (UniqueName: \"kubernetes.io/projected/c6c0df3a-03bb-4854-8648-d00495b75313-kube-api-access-xb2gd\") pod \"ai-gateway-controller-55c8cc7799-jxvjj\" (UID: \"c6c0df3a-03bb-4854-8648-d00495b75313\") " pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.287621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.287581    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:22.589336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.589312    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"]
Oct 30 07:04:22.591479 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:22.591447    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c0df3a_03bb_4854_8648_d00495b75313.slice/crio-48063cbbe031d075100c55215c10d77a5d83fadc88bb1e836f8a5629961261b3 WatchSource:0}: Error finding container 48063cbbe031d075100c55215c10d77a5d83fadc88bb1e836f8a5629961261b3: Status 404 returned error can't find the container with id 48063cbbe031d075100c55215c10d77a5d83fadc88bb1e836f8a5629961261b3
Oct 30 07:04:22.743524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:22.743492    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj" event={"ID":"c6c0df3a-03bb-4854-8648-d00495b75313","Type":"ContainerStarted","Data":"48063cbbe031d075100c55215c10d77a5d83fadc88bb1e836f8a5629961261b3"}
Oct 30 07:04:23.750032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:23.749998    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj" event={"ID":"c6c0df3a-03bb-4854-8648-d00495b75313","Type":"ContainerStarted","Data":"db87a28da143a535a49630278ce1ecbb19c0e7bdc290480856616e9e5b1c6cd8"}
Oct 30 07:04:23.750407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:23.750159    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:23.789116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:23.789026    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj" podStartSLOduration=1.8752034960000001 podStartE2EDuration="2.789014702s" totalImagesPullingTime="913.811206ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:23.788803172 +0000 UTC m=+466.496683342" watchObservedRunningTime="2026-10-30 07:04:23.789014702 +0000 UTC m=+466.496894953"
Oct 30 07:04:26.718394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:26.718364    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-8r9sh"
Oct 30 07:04:26.718895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:26.718539    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-fcr4n"
Oct 30 07:04:34.757438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:34.757406    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-55c8cc7799-jxvjj"
Oct 30 07:04:34.827084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:34.827051    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-m8kq8"]
Oct 30 07:04:34.827309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:34.827272    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8" podUID="8d6ec1b2-c058-43b1-991c-d6e69913ef4b" containerName="manager" containerID="cri-o://78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44" gracePeriod=30
Oct 30 07:04:35.068344 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.068318    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:35.208134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.208091    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv\" (UniqueName: \"kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv\") pod \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") "
Oct 30 07:04:35.208308 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.208171    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs\") pod \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\" (UID: \"8d6ec1b2-c058-43b1-991c-d6e69913ef4b\") "
Oct 30 07:04:35.210326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.210296    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs" pod "8d6ec1b2-c058-43b1-991c-d6e69913ef4b" (UID: "8d6ec1b2-c058-43b1-991c-d6e69913ef4b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:04:35.210436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.210383    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv" pod "8d6ec1b2-c058-43b1-991c-d6e69913ef4b" (UID: "8d6ec1b2-c058-43b1-991c-d6e69913ef4b"). InnerVolumeSpecName "kube-api-access-wltdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:04:35.309055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.308998    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wltdv\" (UniqueName: \"kubernetes.io/projected/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-kube-api-access-wltdv\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:04:35.309055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.309021    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d6ec1b2-c058-43b1-991c-d6e69913ef4b-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:04:35.806113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.806084    5073 generic.go:356] "Generic (PLEG): container finished" podID="8d6ec1b2-c058-43b1-991c-d6e69913ef4b" containerID="78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44" exitCode=0
Oct 30 07:04:35.806523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.806127    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8"
Oct 30 07:04:35.806523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.806174    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8" event={"ID":"8d6ec1b2-c058-43b1-991c-d6e69913ef4b","Type":"ContainerDied","Data":"78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44"}
Oct 30 07:04:35.806523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.806227    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-m8kq8" event={"ID":"8d6ec1b2-c058-43b1-991c-d6e69913ef4b","Type":"ContainerDied","Data":"d5a432e9578ff6bb746b92c2f20cff32472cc3b24bc263109b2765082abbabf3"}
Oct 30 07:04:35.806523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.806249    5073 scope.go:122] "RemoveContainer" containerID="78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44"
Oct 30 07:04:35.815004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.814987    5073 scope.go:122] "RemoveContainer" containerID="78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44"
Oct 30 07:04:35.815258 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:04:35.815239    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44\": container with ID starting with 78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44 not found: ID does not exist" containerID="78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44"
Oct 30 07:04:35.815319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.815268    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44"} err="failed to get container status \"78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44\": rpc error: code = NotFound desc = could not find container \"78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44\": container with ID starting with 78a6334d6d02fc2ea381a1c19d2606c4f809199eae7c28f84fdb52492a32df44 not found: ID does not exist"
Oct 30 07:04:35.854467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.854440    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-m8kq8"]
Oct 30 07:04:35.865606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:35.865582    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-m8kq8"]
Oct 30 07:04:37.420213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:37.420183    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d6ec1b2-c058-43b1-991c-d6e69913ef4b" path="/var/lib/kubelet/pods/8d6ec1b2-c058-43b1-991c-d6e69913ef4b/volumes"
Oct 30 07:04:43.600427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.600387    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"]
Oct 30 07:04:43.601034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.601013    5073 cpu_manager.go:414] "containerMap: removing container" podUID="8d6ec1b2-c058-43b1-991c-d6e69913ef4b" containerName="manager"
Oct 30 07:04:43.601084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.601038    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d6ec1b2-c058-43b1-991c-d6e69913ef4b" containerName="manager"
Oct 30 07:04:43.601215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.601201    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d6ec1b2-c058-43b1-991c-d6e69913ef4b" containerName="manager"
Oct 30 07:04:43.608277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.608251    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.623779 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.623757    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 07:04:43.635101 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.635076    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rlmfx\""
Oct 30 07:04:43.635101 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.635076    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 07:04:43.635279 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.635112    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 07:04:43.637034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.637017    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"]
Oct 30 07:04:43.690408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.690386    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.690511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.690417    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9lw2\" (UniqueName: \"kubernetes.io/projected/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-kube-api-access-t9lw2\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.690511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.690449    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.690592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.690517    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.690592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.690554    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.690655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.690626    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791449    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791488    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9lw2\" (UniqueName: \"kubernetes.io/projected/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-kube-api-access-t9lw2\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791515    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791535    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791565    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791714    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.791973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791957    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.792024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.791975    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.792133 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.792113    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.793889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.793845    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.793969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.793955    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.816059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.816040    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9lw2\" (UniqueName: \"kubernetes.io/projected/4deb6d10-a8fd-4566-8ef3-4b76d69beadf-kube-api-access-t9lw2\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t\" (UID: \"4deb6d10-a8fd-4566-8ef3-4b76d69beadf\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:43.919906 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:04:43.919873    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:04:43.926134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:43.926107    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:44.228688 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:44.228659    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"]
Oct 30 07:04:44.229866 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:44.229825    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4deb6d10_a8fd_4566_8ef3_4b76d69beadf.slice/crio-45041b521b735b69ad8ca3248a0040404c765f00d839574100006e7de06ac6a0 WatchSource:0}: Error finding container 45041b521b735b69ad8ca3248a0040404c765f00d839574100006e7de06ac6a0: Status 404 returned error can't find the container with id 45041b521b735b69ad8ca3248a0040404c765f00d839574100006e7de06ac6a0
Oct 30 07:04:44.853782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:44.853750    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t" event={"ID":"4deb6d10-a8fd-4566-8ef3-4b76d69beadf","Type":"ContainerStarted","Data":"45041b521b735b69ad8ca3248a0040404c765f00d839574100006e7de06ac6a0"}
Oct 30 07:04:45.861720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:45.861623    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t" event={"ID":"4deb6d10-a8fd-4566-8ef3-4b76d69beadf","Type":"ContainerStarted","Data":"feffa606dae3dac957a6ada85e1cf8890b566478acfe9b69c36bc6f62f0690e7"}
Oct 30 07:04:45.903350 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:45.903289    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t" podStartSLOduration=1.615785465 podStartE2EDuration="2.903269616s" totalImagesPullingTime="1.287484151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:45.901701962 +0000 UTC m=+488.609582131" watchObservedRunningTime="2026-10-30 07:04:45.903269616 +0000 UTC m=+488.611149786"
Oct 30 07:04:45.927123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:45.927098    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:47.971129 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:47.970936    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"]
Oct 30 07:04:47.976674 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:47.976646    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.006073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.006042    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 07:04:48.009017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.008992    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"]
Oct 30 07:04:48.032579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.032553    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.032704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.032590    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdclm\" (UniqueName: \"kubernetes.io/projected/acf27cf6-13c7-4035-b080-77e8afedd8f5-kube-api-access-fdclm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.032704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.032611    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.032792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.032706    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.032837 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.032812    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf27cf6-13c7-4035-b080-77e8afedd8f5-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.032837 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.032830    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.133933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.133894    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.133956    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.133995    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf27cf6-13c7-4035-b080-77e8afedd8f5-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.134013    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.134070    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.134106    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdclm\" (UniqueName: \"kubernetes.io/projected/acf27cf6-13c7-4035-b080-77e8afedd8f5-kube-api-access-fdclm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.134341    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.134387    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.134477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.134462    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.136198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.136176    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf27cf6-13c7-4035-b080-77e8afedd8f5-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.136475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.136456    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf27cf6-13c7-4035-b080-77e8afedd8f5-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.157415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.157389    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdclm\" (UniqueName: \"kubernetes.io/projected/acf27cf6-13c7-4035-b080-77e8afedd8f5-kube-api-access-fdclm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-tdzqs\" (UID: \"acf27cf6-13c7-4035-b080-77e8afedd8f5\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.291105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.291016    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:48.588935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.588906    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"]
Oct 30 07:04:48.589872 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:48.589834    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf27cf6_13c7_4035_b080_77e8afedd8f5.slice/crio-6204c5b5d04d75f3a0e40b4fa5206eddfc21e490bc733effc510db31b6d2dee9 WatchSource:0}: Error finding container 6204c5b5d04d75f3a0e40b4fa5206eddfc21e490bc733effc510db31b6d2dee9: Status 404 returned error can't find the container with id 6204c5b5d04d75f3a0e40b4fa5206eddfc21e490bc733effc510db31b6d2dee9
Oct 30 07:04:48.878156 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.878122    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs" event={"ID":"acf27cf6-13c7-4035-b080-77e8afedd8f5","Type":"ContainerStarted","Data":"4558e43b07142764958ee377b3f828fb6b7b9945694af4cc29246617c44776f7"}
Oct 30 07:04:48.878364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.878182    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs" event={"ID":"acf27cf6-13c7-4035-b080-77e8afedd8f5","Type":"ContainerStarted","Data":"6204c5b5d04d75f3a0e40b4fa5206eddfc21e490bc733effc510db31b6d2dee9"}
Oct 30 07:04:48.918175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:48.918114    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs" podStartSLOduration=1.7394212919999998 podStartE2EDuration="1.918046042s" totalImagesPullingTime="178.62475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:48.917760566 +0000 UTC m=+491.625640735" watchObservedRunningTime="2026-10-30 07:04:48.918046042 +0000 UTC m=+491.625926226"
Oct 30 07:04:49.291910 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:49.291827    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:50.570254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.570222    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"]
Oct 30 07:04:50.574474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.574439    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.588574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.588555    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 07:04:50.602489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.602461    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"]
Oct 30 07:04:50.656214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.656181    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzb2f\" (UniqueName: \"kubernetes.io/projected/760a53d6-8c6d-4254-b222-c81d7993ac48-kube-api-access-jzb2f\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.656395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.656230    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/760a53d6-8c6d-4254-b222-c81d7993ac48-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.656467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.656410    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.656514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.656471    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.656550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.656515    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.656581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.656548    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.764426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.764386    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzb2f\" (UniqueName: \"kubernetes.io/projected/760a53d6-8c6d-4254-b222-c81d7993ac48-kube-api-access-jzb2f\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.764611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.764447    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/760a53d6-8c6d-4254-b222-c81d7993ac48-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.764611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.764523    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.764611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.764567    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.765391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.764617    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.765391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.764650    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.765391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.765110    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.765391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.765122    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.765667 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.765647    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.768219 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.768196    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/760a53d6-8c6d-4254-b222-c81d7993ac48-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.768424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.768402    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/760a53d6-8c6d-4254-b222-c81d7993ac48-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.786902 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.786876    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzb2f\" (UniqueName: \"kubernetes.io/projected/760a53d6-8c6d-4254-b222-c81d7993ac48-kube-api-access-jzb2f\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ddv95\" (UID: \"760a53d6-8c6d-4254-b222-c81d7993ac48\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:50.894721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:50.894694    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:51.195652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:51.195624    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"]
Oct 30 07:04:51.197239 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:51.197143    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760a53d6_8c6d_4254_b222_c81d7993ac48.slice/crio-91745bd842701ee9b72c09d4454108beafea3240eb4fbb98aeaffb4b075d25d2 WatchSource:0}: Error finding container 91745bd842701ee9b72c09d4454108beafea3240eb4fbb98aeaffb4b075d25d2: Status 404 returned error can't find the container with id 91745bd842701ee9b72c09d4454108beafea3240eb4fbb98aeaffb4b075d25d2
Oct 30 07:04:51.895786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:51.895735    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95" event={"ID":"760a53d6-8c6d-4254-b222-c81d7993ac48","Type":"ContainerStarted","Data":"0de3aa87c50f76bb80c2c663a536d4fd56a3a16b8c8d3b29538508e16bf98db7"}
Oct 30 07:04:51.896340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:51.895813    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95" event={"ID":"760a53d6-8c6d-4254-b222-c81d7993ac48","Type":"ContainerStarted","Data":"91745bd842701ee9b72c09d4454108beafea3240eb4fbb98aeaffb4b075d25d2"}
Oct 30 07:04:51.937868 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:51.937813    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95" podStartSLOduration=1.759731472 podStartE2EDuration="1.937801664s" totalImagesPullingTime="178.070192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:51.937796962 +0000 UTC m=+494.645677131" watchObservedRunningTime="2026-10-30 07:04:51.937801664 +0000 UTC m=+494.645681832"
Oct 30 07:04:52.895493 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:52.895460    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:04:53.926540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:53.926499    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:53.944965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:53.944937    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:54.924552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:54.924520    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t"
Oct 30 07:04:55.068911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.068874    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"]
Oct 30 07:04:55.077141 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.077112    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.095283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.091485    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 07:04:55.095457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.094837    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"]
Oct 30 07:04:55.211059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.210970    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.211059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.211016    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e3ca7d-1f71-4597-b02b-064d4f67a85c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.211059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.211046    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.211345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.211189    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.211345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.211265    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.211345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.211321    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdww4\" (UniqueName: \"kubernetes.io/projected/45e3ca7d-1f71-4597-b02b-064d4f67a85c-kube-api-access-kdww4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.312547 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312504    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.312739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312603    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.312739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312647    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdww4\" (UniqueName: \"kubernetes.io/projected/45e3ca7d-1f71-4597-b02b-064d4f67a85c-kube-api-access-kdww4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.312739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312692    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.312739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312738    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e3ca7d-1f71-4597-b02b-064d4f67a85c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.313018 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312767    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.313018 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.312993    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.313138 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.313071    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.313330 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.313306    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.315518 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.315491    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e3ca7d-1f71-4597-b02b-064d4f67a85c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.315645 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.315539    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e3ca7d-1f71-4597-b02b-064d4f67a85c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.335645 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.335616    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdww4\" (UniqueName: \"kubernetes.io/projected/45e3ca7d-1f71-4597-b02b-064d4f67a85c-kube-api-access-kdww4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv\" (UID: \"45e3ca7d-1f71-4597-b02b-064d4f67a85c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.400789 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.400753    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:55.712417 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.712392    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"]
Oct 30 07:04:55.713645 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:55.713618    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e3ca7d_1f71_4597_b02b_064d4f67a85c.slice/crio-cb7bae39d78c95bde30ff331edbd59087802ae0757f2c686187f5423fa4c9c6f WatchSource:0}: Error finding container cb7bae39d78c95bde30ff331edbd59087802ae0757f2c686187f5423fa4c9c6f: Status 404 returned error can't find the container with id cb7bae39d78c95bde30ff331edbd59087802ae0757f2c686187f5423fa4c9c6f
Oct 30 07:04:55.917596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:55.917567    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv" event={"ID":"45e3ca7d-1f71-4597-b02b-064d4f67a85c","Type":"ContainerStarted","Data":"cb7bae39d78c95bde30ff331edbd59087802ae0757f2c686187f5423fa4c9c6f"}
Oct 30 07:04:56.266638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.266598    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-rvj8l"]
Oct 30 07:04:56.270754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.270729    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.297000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.296973    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 30 07:04:56.301300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.301265    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-rvj8l"]
Oct 30 07:04:56.323480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.323446    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.323655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.323491    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf8xk\" (UniqueName: \"kubernetes.io/projected/038e5c00-5b1d-43e5-b566-0783c6e46b8f-kube-api-access-vf8xk\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.323655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.323557    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.323655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.323584    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.323655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.323652    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/038e5c00-5b1d-43e5-b566-0783c6e46b8f-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.323908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.323698    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-home\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.424830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.424792    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.424830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.424830    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf8xk\" (UniqueName: \"kubernetes.io/projected/038e5c00-5b1d-43e5-b566-0783c6e46b8f-kube-api-access-vf8xk\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.424910    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.425036    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.425141    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/038e5c00-5b1d-43e5-b566-0783c6e46b8f-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.425196    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-home\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.425266    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425429 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.425403    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.425591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.425570    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-home\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.427478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.427447    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/038e5c00-5b1d-43e5-b566-0783c6e46b8f-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.427620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.427600    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/038e5c00-5b1d-43e5-b566-0783c6e46b8f-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.448414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.448387    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf8xk\" (UniqueName: \"kubernetes.io/projected/038e5c00-5b1d-43e5-b566-0783c6e46b8f-kube-api-access-vf8xk\") pod \"echo-simulator-kserve-64b6f8f96c-rvj8l\" (UID: \"038e5c00-5b1d-43e5-b566-0783c6e46b8f\") " pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.593020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.592927    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:04:56.932882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.931829    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-rvj8l"]
Oct 30 07:04:56.937881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.935499    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv" event={"ID":"45e3ca7d-1f71-4597-b02b-064d4f67a85c","Type":"ContainerStarted","Data":"3ce2a32d70f6b1c799a10a16b31c232b4b37ae5775bf689ea49da7270ef18081"}
Oct 30 07:04:56.942124 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:04:56.942099    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038e5c00_5b1d_43e5_b566_0783c6e46b8f.slice/crio-71e76816d087fbfc41875d377f236e036d7c9bbdf075b6b041cdb2fe397b95da WatchSource:0}: Error finding container 71e76816d087fbfc41875d377f236e036d7c9bbdf075b6b041cdb2fe397b95da: Status 404 returned error can't find the container with id 71e76816d087fbfc41875d377f236e036d7c9bbdf075b6b041cdb2fe397b95da
Oct 30 07:04:56.982182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:56.982134    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv" podStartSLOduration=1.806838939 podStartE2EDuration="1.98212134s" totalImagesPullingTime="175.282401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:56.980602022 +0000 UTC m=+499.688482191" watchObservedRunningTime="2026-10-30 07:04:56.98212134 +0000 UTC m=+499.690001509"
Oct 30 07:04:57.400991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:57.400953    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:04:57.947370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:57.947331    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l" event={"ID":"038e5c00-5b1d-43e5-b566-0783c6e46b8f","Type":"ContainerStarted","Data":"71e76816d087fbfc41875d377f236e036d7c9bbdf075b6b041cdb2fe397b95da"}
Oct 30 07:04:58.291676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:58.291589    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:58.311224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:58.311195    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:58.953387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:58.953345    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l" event={"ID":"038e5c00-5b1d-43e5-b566-0783c6e46b8f","Type":"ContainerStarted","Data":"47d6dbaf75c57f47b75693ab241a973d5bd12987feaae4d150482375061fb367"}
Oct 30 07:04:58.964639 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:58.964618    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-tdzqs"
Oct 30 07:04:58.997917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:58.997870    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l" podStartSLOduration=1.362360115 podStartE2EDuration="2.997843073s" totalImagesPullingTime="1.635482958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:04:58.995846115 +0000 UTC m=+501.703726284" watchObservedRunningTime="2026-10-30 07:04:58.997843073 +0000 UTC m=+501.705723255"
Oct 30 07:04:59.593630 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:04:59.593595    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:05:00.895164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:00.895125    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:05:00.909189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:00.909153    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:05:00.979205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:00.979174    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ddv95"
Oct 30 07:05:05.401392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:05.401350    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:05:05.421963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:05.421931    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:05:06.008503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:06.008464    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv"
Oct 30 07:05:06.594136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:06.594076    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:05:06.607455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:06.607419    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:05:07.017306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:07.017268    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-rvj8l"
Oct 30 07:05:13.920996 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:05:13.920961    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:05:16.055787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.055748    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d9d797f85-rbbws"]
Oct 30 07:05:16.061652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.061629    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.079388 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.079361    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9d797f85-rbbws"]
Oct 30 07:05:16.242944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.242905    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/391cc1a6-2092-4420-87db-4dca9e49d66a-tls-cert\") pod \"authorino-d9d797f85-rbbws\" (UID: \"391cc1a6-2092-4420-87db-4dca9e49d66a\") " pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.243093 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.243044    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmdv\" (UniqueName: \"kubernetes.io/projected/391cc1a6-2092-4420-87db-4dca9e49d66a-kube-api-access-wkmdv\") pod \"authorino-d9d797f85-rbbws\" (UID: \"391cc1a6-2092-4420-87db-4dca9e49d66a\") " pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.344411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.344330    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmdv\" (UniqueName: \"kubernetes.io/projected/391cc1a6-2092-4420-87db-4dca9e49d66a-kube-api-access-wkmdv\") pod \"authorino-d9d797f85-rbbws\" (UID: \"391cc1a6-2092-4420-87db-4dca9e49d66a\") " pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.344563 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.344482    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/391cc1a6-2092-4420-87db-4dca9e49d66a-tls-cert\") pod \"authorino-d9d797f85-rbbws\" (UID: \"391cc1a6-2092-4420-87db-4dca9e49d66a\") " pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.346891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.346865    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/391cc1a6-2092-4420-87db-4dca9e49d66a-tls-cert\") pod \"authorino-d9d797f85-rbbws\" (UID: \"391cc1a6-2092-4420-87db-4dca9e49d66a\") " pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.367668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.367634    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmdv\" (UniqueName: \"kubernetes.io/projected/391cc1a6-2092-4420-87db-4dca9e49d66a-kube-api-access-wkmdv\") pod \"authorino-d9d797f85-rbbws\" (UID: \"391cc1a6-2092-4420-87db-4dca9e49d66a\") " pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.373453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.373427    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9d797f85-rbbws"
Oct 30 07:05:16.677938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:16.677903    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9d797f85-rbbws"]
Oct 30 07:05:16.678135 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:16.678109    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod391cc1a6_2092_4420_87db_4dca9e49d66a.slice/crio-4af7a7cdd0064ea16751731f859d003325342fb128b7d8db474f84d4e42850e9 WatchSource:0}: Error finding container 4af7a7cdd0064ea16751731f859d003325342fb128b7d8db474f84d4e42850e9: Status 404 returned error can't find the container with id 4af7a7cdd0064ea16751731f859d003325342fb128b7d8db474f84d4e42850e9
Oct 30 07:05:17.055451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:17.055420    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9d797f85-rbbws" event={"ID":"391cc1a6-2092-4420-87db-4dca9e49d66a","Type":"ContainerStarted","Data":"4af7a7cdd0064ea16751731f859d003325342fb128b7d8db474f84d4e42850e9"}
Oct 30 07:05:18.063135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.063091    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9d797f85-rbbws" event={"ID":"391cc1a6-2092-4420-87db-4dca9e49d66a","Type":"ContainerStarted","Data":"f2e21e321fa9f27d55cd5d9804f460044f6ae1c1ca83151e4038dc56bf05c795"}
Oct 30 07:05:18.102889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.102783    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-d9d797f85-rbbws" podStartSLOduration=1.732268586 podStartE2EDuration="2.102761706s" totalImagesPullingTime="370.49312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:18.101616627 +0000 UTC m=+520.809496793" watchObservedRunningTime="2026-10-30 07:05:18.102761706 +0000 UTC m=+520.810641946"
Oct 30 07:05:18.135069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.135033    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f78f8b74-vcmbh"]
Oct 30 07:05:18.135487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.135457    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-f78f8b74-vcmbh" podUID="cd019cca-505f-40d3-8033-75866818aeed" containerName="authorino" containerID="cri-o://229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a" gracePeriod=30
Oct 30 07:05:18.432134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.432103    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:05:18.572633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.572592    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw\" (UniqueName: \"kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw\") pod \"cd019cca-505f-40d3-8033-75866818aeed\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") "
Oct 30 07:05:18.572806 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.572721    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert\" (UniqueName: \"kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert\") pod \"cd019cca-505f-40d3-8033-75866818aeed\" (UID: \"cd019cca-505f-40d3-8033-75866818aeed\") "
Oct 30 07:05:18.574693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.574664    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw" pod "cd019cca-505f-40d3-8033-75866818aeed" (UID: "cd019cca-505f-40d3-8033-75866818aeed"). InnerVolumeSpecName "kube-api-access-rz5tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:05:18.584163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.584105    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert" pod "cd019cca-505f-40d3-8033-75866818aeed" (UID: "cd019cca-505f-40d3-8033-75866818aeed"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:05:18.674158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.674118    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz5tw\" (UniqueName: \"kubernetes.io/projected/cd019cca-505f-40d3-8033-75866818aeed-kube-api-access-rz5tw\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:05:18.674158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:18.674158    5073 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd019cca-505f-40d3-8033-75866818aeed-tls-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:05:19.070746 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.070711    5073 generic.go:356] "Generic (PLEG): container finished" podID="cd019cca-505f-40d3-8033-75866818aeed" containerID="229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a" exitCode=0
Oct 30 07:05:19.071233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.070777    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f78f8b74-vcmbh"
Oct 30 07:05:19.071233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.070796    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f78f8b74-vcmbh" event={"ID":"cd019cca-505f-40d3-8033-75866818aeed","Type":"ContainerDied","Data":"229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a"}
Oct 30 07:05:19.071233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.070847    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f78f8b74-vcmbh" event={"ID":"cd019cca-505f-40d3-8033-75866818aeed","Type":"ContainerDied","Data":"e3e509be24460d2b8c81e8d0469063da9986691ff3be47d85a34f6625ce76830"}
Oct 30 07:05:19.071233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.070934    5073 scope.go:122] "RemoveContainer" containerID="229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a"
Oct 30 07:05:19.083518 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.083495    5073 scope.go:122] "RemoveContainer" containerID="229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a"
Oct 30 07:05:19.083847 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:05:19.083826    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a\": container with ID starting with 229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a not found: ID does not exist" containerID="229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a"
Oct 30 07:05:19.083965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.083872    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a"} err="failed to get container status \"229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a\": rpc error: code = NotFound desc = could not find container \"229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a\": container with ID starting with 229bc8440bef4ac5af2c30490e318be87582dccada1fd3b0dc636e963b731a0a not found: ID does not exist"
Oct 30 07:05:19.121022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.120988    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f78f8b74-vcmbh"]
Oct 30 07:05:19.132274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.132235    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f78f8b74-vcmbh"]
Oct 30 07:05:19.424810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:19.424780    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd019cca-505f-40d3-8033-75866818aeed" path="/var/lib/kubelet/pods/cd019cca-505f-40d3-8033-75866818aeed/volumes"
Oct 30 07:05:22.380879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.380831    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"]
Oct 30 07:05:22.381321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.381305    5073 cpu_manager.go:414] "containerMap: removing container" podUID="cd019cca-505f-40d3-8033-75866818aeed" containerName="authorino"
Oct 30 07:05:22.381376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.381323    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd019cca-505f-40d3-8033-75866818aeed" containerName="authorino"
Oct 30 07:05:22.381412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.381407    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd019cca-505f-40d3-8033-75866818aeed" containerName="authorino"
Oct 30 07:05:22.386513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.386491    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.416873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.415968    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"]
Oct 30 07:05:22.517095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517056    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517096    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517118    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517235    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517277    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517294    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m58bj\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517363    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517388    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.517492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.517484    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618338    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618391    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618472    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618516    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618542    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618567    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618610    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618660    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.618841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618689    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m58bj\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.619027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618901    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.619027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.618974    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.619131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.619070    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.619358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.619335    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.619448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.619427    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.621058 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.621029    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.621240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.621224    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.641407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.641351    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m58bj\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.641407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.641388    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-22jpl\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:22.704065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:22.704025    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:23.025754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.025728    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"]
Oct 30 07:05:23.027954 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:23.027928    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01286ad_b10e_4cb4_b2b1_46ad89d3c27b.slice/crio-a482763c994593948602fddb77b60168de14e8e9c269f23a5da415d7612a5e52 WatchSource:0}: Error finding container a482763c994593948602fddb77b60168de14e8e9c269f23a5da415d7612a5e52: Status 404 returned error can't find the container with id a482763c994593948602fddb77b60168de14e8e9c269f23a5da415d7612a5e52
Oct 30 07:05:23.030061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.030033    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:23.030111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.030094    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:23.030153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.030122    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:23.096698 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.096661    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" event={"ID":"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b","Type":"ContainerStarted","Data":"203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d"}
Oct 30 07:05:23.096817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.096719    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" event={"ID":"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b","Type":"ContainerStarted","Data":"a482763c994593948602fddb77b60168de14e8e9c269f23a5da415d7612a5e52"}
Oct 30 07:05:23.142985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.142936    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podStartSLOduration=1.142923173 podStartE2EDuration="1.142923173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:23.140907092 +0000 UTC m=+525.848787262" watchObservedRunningTime="2026-10-30 07:05:23.142923173 +0000 UTC m=+525.850803341"
Oct 30 07:05:23.705198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:23.705155    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:24.706819 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:24.706787    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 07:05:24.707254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:24.706841    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 07:05:25.705466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:25.705424    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 07:05:25.705656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:25.705491    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 07:05:26.704755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:26.704717    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 07:05:26.705434 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:26.705400    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 07:05:27.704468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:27.704432    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 07:05:27.704643 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:27.704511    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 07:05:28.704592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:28.704552    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 07:05:28.705007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:28.704618    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 07:05:29.704567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:29.704521    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 07:05:29.704782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:29.704577    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 07:05:31.222682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:31.222649    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:31.223141 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:31.222975    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:31.224071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:31.224051    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:05:37.379049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.379021    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"]
Oct 30 07:05:37.387615 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.387593    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.422694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.422667    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"]
Oct 30 07:05:37.491880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.491835    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.491949    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqx2\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492041    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492090 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492064    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492090 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492083    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492220    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492278    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492311    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.492382 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.492361    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593379 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593337    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593379 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593388    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593407    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593425    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593470    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593593    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqx2\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593704    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593740    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.593836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593772    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.594039 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.593910    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.594158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.594127    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.594158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.594146    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.594298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.594184    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.594298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.594274    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.595531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.595511    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.595828 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.595811    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.616579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.616555    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.616797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.616778    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqx2\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2\") pod \"maas-default-gateway-openshift-default-6dcf757899-h7xgz\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:37.702404 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:37.702321    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:38.018409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.018377    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"]
Oct 30 07:05:38.019599 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:38.019573    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c80e0f0_c8de_4b70_aea3_4838ab726f8b.slice/crio-97c146aea88684665c4a32cdaad3caba8b4577854faa1941f1ee1b03f9b92cb8 WatchSource:0}: Error finding container 97c146aea88684665c4a32cdaad3caba8b4577854faa1941f1ee1b03f9b92cb8: Status 404 returned error can't find the container with id 97c146aea88684665c4a32cdaad3caba8b4577854faa1941f1ee1b03f9b92cb8
Oct 30 07:05:38.021794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.021762    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:38.021903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.021825    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:38.021903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.021882    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:38.180508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.180469    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" event={"ID":"2c80e0f0-c8de-4b70-aea3-4838ab726f8b","Type":"ContainerStarted","Data":"6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058"}
Oct 30 07:05:38.180690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.180530    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" event={"ID":"2c80e0f0-c8de-4b70-aea3-4838ab726f8b","Type":"ContainerStarted","Data":"97c146aea88684665c4a32cdaad3caba8b4577854faa1941f1ee1b03f9b92cb8"}
Oct 30 07:05:38.226799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.226749    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podStartSLOduration=1.226735433 podStartE2EDuration="1.226735433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:38.224515091 +0000 UTC m=+540.932395263" watchObservedRunningTime="2026-10-30 07:05:38.226735433 +0000 UTC m=+540.934615595"
Oct 30 07:05:38.702536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:38.702496    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:39.704364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:39.704331    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 07:05:39.704774 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:39.704394    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 07:05:40.702660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:40.702622    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 07:05:40.702819 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:40.702689    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 07:05:41.702951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:41.702911    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 07:05:41.703424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:41.702968    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 07:05:42.703372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:42.703342    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 07:05:42.703759 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:42.703395    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 07:05:43.703014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:43.702976    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 07:05:43.703200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:43.703036    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 07:05:43.923842 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:05:43.923805    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:05:44.703468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:44.703424    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 07:05:44.703645 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:44.703493    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 07:05:46.196686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:46.196650    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:46.197201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:46.197006    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:46.198016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:46.197991    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:05:48.775007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.774968    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"]
Oct 30 07:05:48.782521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.782488    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.804660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.798744    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a1a08662-openshift-default-dockercfg-bjkxt\""
Oct 30 07:05:48.815399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.815367    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"]
Oct 30 07:05:48.903772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.903736    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.903772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.903774    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.903929    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.903997    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904087 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.904040    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65cb\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.904089    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904170 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.904128    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.904191    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.904247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.904222    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:48.930222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.930188    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"]
Oct 30 07:05:48.934844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.934816    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:48.961007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.960975    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"]
Oct 30 07:05:48.990278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:48.990252    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a9eddc5d-openshift-default-dockercfg-9t2lp\""
Oct 30 07:05:49.005492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005459    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.005676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005510    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.005676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005544    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.005800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005727    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.005800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005752    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.005931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005814    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.005931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005886    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005952    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65cb\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005981    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.006073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.005998    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006081    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspkg\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.006221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006136    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006205    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006265    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.006366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006307    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006369    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.006498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006429    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.006498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006468    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.007236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006516    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.007236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.006868    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.007355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.007312    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.007634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.007614    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.007880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.007833    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.010305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.010276    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.010570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.010554    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.033755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.033689    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.033887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.033765    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65cb\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb\") pod \"e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") " pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.102793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.102762    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:49.107150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107103    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspkg\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107151    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107178    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107234    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107266    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107314    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107419 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107338    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107419 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107385    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107432    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107769    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107809    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.107922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.107875    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.108025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.108004    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.108109 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.108094    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.109535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.109517    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.110405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.110381    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.132157 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.132094    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.152958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.152928    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspkg\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg\") pod \"e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") " pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.212770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.212730    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"]
Oct 30 07:05:49.220481 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.220455    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.254642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.254616    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:49.290396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.290316    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-414c5686-gw-openshift-default-dockercfg-vdgwx\""
Oct 30 07:05:49.296887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.292586    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"]
Oct 30 07:05:49.316770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.316731    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.316885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.316828    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317039    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317117 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317085    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqwh\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317118    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317151    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317179    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317216    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.317290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.317248    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.417782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.417745    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.417967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.417819    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.417967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.417870    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.417967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.417899    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqwh\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.417967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.417929    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.417967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.417958    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418166    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418230    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418262    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418323    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418651    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418764    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418767    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.418891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.418843    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.420231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.420208    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.420783 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.420766    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.440553 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.440528    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.440655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.440598    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqwh\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh\") pod \"e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") " pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.465391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.465367    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"]
Oct 30 07:05:49.465552 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:49.465532    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode935b98f_05c0_422a_8393_73bfe1ca97a3.slice/crio-8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d WatchSource:0}: Error finding container 8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d: Status 404 returned error can't find the container with id 8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d
Oct 30 07:05:49.467551 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.467525    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.467596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.467581    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.467637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.467608    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.534619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.534591    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:49.566051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.566021    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"]
Oct 30 07:05:49.576306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.576264    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.576403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.576331    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.576403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.576360    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.856207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.856178    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"]
Oct 30 07:05:49.857434 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:49.857405    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38b54d8_5348_4d08_9b47_65b50d35605e.slice/crio-5ee6996cc76c5f29dd6551196136cd5d7b60762c932f81abb2a55e865ba5832b WatchSource:0}: Error finding container 5ee6996cc76c5f29dd6551196136cd5d7b60762c932f81abb2a55e865ba5832b: Status 404 returned error can't find the container with id 5ee6996cc76c5f29dd6551196136cd5d7b60762c932f81abb2a55e865ba5832b
Oct 30 07:05:49.860078 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.860045    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.860161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.860112    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:49.860161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:49.860140    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:50.260078 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.260031    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" event={"ID":"e935b98f-05c0-422a-8393-73bfe1ca97a3","Type":"ContainerStarted","Data":"7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"}
Oct 30 07:05:50.260281 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.260094    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" event={"ID":"e935b98f-05c0-422a-8393-73bfe1ca97a3","Type":"ContainerStarted","Data":"8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d"}
Oct 30 07:05:50.261679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.261641    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" event={"ID":"fbdcb8fd-130f-4cf2-b11a-1fd9534824de","Type":"ContainerStarted","Data":"a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"}
Oct 30 07:05:50.261887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.261699    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" event={"ID":"fbdcb8fd-130f-4cf2-b11a-1fd9534824de","Type":"ContainerStarted","Data":"c01b0e5f05f96b1f181f456c3cdc10a863f9ae0d5fd0ba5d38826cbeffa14d8d"}
Oct 30 07:05:50.263196 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.263169    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" event={"ID":"e38b54d8-5348-4d08-9b47-65b50d35605e","Type":"ContainerStarted","Data":"41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"}
Oct 30 07:05:50.263297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.263223    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" event={"ID":"e38b54d8-5348-4d08-9b47-65b50d35605e","Type":"ContainerStarted","Data":"5ee6996cc76c5f29dd6551196136cd5d7b60762c932f81abb2a55e865ba5832b"}
Oct 30 07:05:50.304437 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.304371    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podStartSLOduration=2.3043567449999998 podStartE2EDuration="2.304356745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:50.30327207 +0000 UTC m=+553.011152242" watchObservedRunningTime="2026-10-30 07:05:50.304356745 +0000 UTC m=+553.012236913"
Oct 30 07:05:50.350220 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.350162    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podStartSLOduration=2.350147608 podStartE2EDuration="2.350147608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:50.347450763 +0000 UTC m=+553.055330933" watchObservedRunningTime="2026-10-30 07:05:50.350147608 +0000 UTC m=+553.058027776"
Oct 30 07:05:50.391979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.391919    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podStartSLOduration=1.3919012290000001 podStartE2EDuration="1.391901229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:50.390766456 +0000 UTC m=+553.098646625" watchObservedRunningTime="2026-10-30 07:05:50.391901229 +0000 UTC m=+553.099781398"
Oct 30 07:05:50.535869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.535772    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:50.537349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.537316    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"]
Oct 30 07:05:50.548154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.542034    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:50.548154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.542102    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.566123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.566095    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"]
Oct 30 07:05:50.597063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.597034    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5b764790-openshift-default-dockercfg-2fhgl\""
Oct 30 07:05:50.632609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632578    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.632763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632629    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.632763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632731    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.632763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632757    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.632898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632786    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.632935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632909    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.632970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.632940    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.633042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.633030    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2m5\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.633077 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.633051    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.733996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.733961    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734009    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734071    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2m5\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734101    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734142    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734199    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734262    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734312    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734348    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734436    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734570    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734715 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734659    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.734963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.734937    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.735236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.735214    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.736672 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.736652    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.736840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.736809    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.763933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.763884    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2m5\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.765065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.765041    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token\") pod \"e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") " pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:50.857420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:50.857329    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:51.103431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.103395    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:51.108963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.108889    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:51.191509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.191478    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"]
Oct 30 07:05:51.191628 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:51.191550    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20345eaf_ee37_4638_a965_dd76ec2ce108.slice/crio-78ecfde44c7ae18ba48b7dc24c44b4d55488fc0d87456ceb2a910adc65285790 WatchSource:0}: Error finding container 78ecfde44c7ae18ba48b7dc24c44b4d55488fc0d87456ceb2a910adc65285790: Status 404 returned error can't find the container with id 78ecfde44c7ae18ba48b7dc24c44b4d55488fc0d87456ceb2a910adc65285790
Oct 30 07:05:51.193982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.193950    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:51.194064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.194014    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:51.194064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.194042    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:05:51.255647 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.255618    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:51.261079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.261057    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:51.272768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.272726    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" event={"ID":"20345eaf-ee37-4638-a965-dd76ec2ce108","Type":"ContainerStarted","Data":"78ecfde44c7ae18ba48b7dc24c44b4d55488fc0d87456ceb2a910adc65285790"}
Oct 30 07:05:51.273636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.273610    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:51.273725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.273666    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:51.273725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.273693    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:51.274529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.274491    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:05:51.274677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.274663    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:05:51.275947 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:51.275923    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:05:52.280215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:52.280177    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" event={"ID":"20345eaf-ee37-4638-a965-dd76ec2ce108","Type":"ContainerStarted","Data":"4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"}
Oct 30 07:05:52.337063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:52.336994    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podStartSLOduration=2.336975483 podStartE2EDuration="2.336975483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:52.335554483 +0000 UTC m=+555.043434652" watchObservedRunningTime="2026-10-30 07:05:52.336975483 +0000 UTC m=+555.044855651"
Oct 30 07:05:52.858180 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:52.858142    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:52.863791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:52.863761    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:53.286233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:53.286201    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:53.286826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:53.286807    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:05:54.041963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.041927    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"]
Oct 30 07:05:54.046182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.046160    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.066254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.066229    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-414c5686-serving-cert\""
Oct 30 07:05:54.066444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.066428    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 07:05:54.070748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.070086    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"]
Oct 30 07:05:54.077735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.077715    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lnjcd\""
Oct 30 07:05:54.082909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.082879    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.083050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.082925    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.083050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.082989    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsj8d\" (UniqueName: \"kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.083050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.083021    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.183773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.183734    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.183773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.183775    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.184058 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.183815    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsj8d\" (UniqueName: \"kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.184058 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.183838    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.184570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.184551    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.186367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.186346    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.186506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.186483    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.210220 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.210187    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsj8d\" (UniqueName: \"kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d\") pod \"maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.360098 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.359988    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:54.662277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:54.662247    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"]
Oct 30 07:05:54.662972 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:54.662941    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32cacd2_5e67_4c4b_9318_82c3259e788e.slice/crio-a5dac17d501914c8965ccc603343a264ab8cfeb7bcd8abaa4b008e2389160ab3 WatchSource:0}: Error finding container a5dac17d501914c8965ccc603343a264ab8cfeb7bcd8abaa4b008e2389160ab3: Status 404 returned error can't find the container with id a5dac17d501914c8965ccc603343a264ab8cfeb7bcd8abaa4b008e2389160ab3
Oct 30 07:05:55.311929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:55.311883    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn" event={"ID":"b32cacd2-5e67-4c4b-9318-82c3259e788e","Type":"ContainerStarted","Data":"4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28"}
Oct 30 07:05:55.312075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:55.311951    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn" event={"ID":"b32cacd2-5e67-4c4b-9318-82c3259e788e","Type":"ContainerStarted","Data":"a5dac17d501914c8965ccc603343a264ab8cfeb7bcd8abaa4b008e2389160ab3"}
Oct 30 07:05:55.312075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:55.312045    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:05:55.372797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:55.372719    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn" podStartSLOduration=0.81903233 podStartE2EDuration="1.37269851s" totalImagesPullingTime="553.66618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:05:55.362357533 +0000 UTC m=+558.070237705" watchObservedRunningTime="2026-10-30 07:05:55.37269851 +0000 UTC m=+558.080578680"
Oct 30 07:05:58.405074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.402389    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"]
Oct 30 07:05:58.407541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.407515    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.426989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.426958    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"]
Oct 30 07:05:58.435229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.435195    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a9eddc5d-serving-cert\""
Oct 30 07:05:58.447017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.446986    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.447186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.447034    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2twh\" (UniqueName: \"kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.447280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.447250    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.447336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.447288    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.548950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.548911    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.549121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.548954    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.549121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.549055    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.549121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.549096    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2twh\" (UniqueName: \"kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.549677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.549648    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.551350 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.551329    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.551485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.551466    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.581833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.581800    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2twh\" (UniqueName: \"kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh\") pod \"maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.722804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.722713    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:05:58.810298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.808638    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"]
Oct 30 07:05:58.816236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.815590    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:58.832151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.832121    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5b764790\""
Oct 30 07:05:58.832604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.832489    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5b764790-dockercfg-x6ljq\""
Oct 30 07:05:58.837464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.837440    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"]
Oct 30 07:05:58.852779 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.852752    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22p59\" (UniqueName: \"kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59\") pod \"payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:58.852933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.852911    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:58.954205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.954163    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22p59\" (UniqueName: \"kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59\") pod \"payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:58.954406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.954293    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:58.955068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.955043    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:58.977008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:58.976941    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22p59\" (UniqueName: \"kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59\") pod \"payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:59.028772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:59.028737    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"]
Oct 30 07:05:59.029045 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:59.029001    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaff83bb_e8d6_4452_b875_841be7fc151f.slice/crio-0d85c9923e20bd36d28581a6ea6ff593808a10ce763ec4afae1636feb772b527 WatchSource:0}: Error finding container 0d85c9923e20bd36d28581a6ea6ff593808a10ce763ec4afae1636feb772b527: Status 404 returned error can't find the container with id 0d85c9923e20bd36d28581a6ea6ff593808a10ce763ec4afae1636feb772b527
Oct 30 07:05:59.140722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:59.140693    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:05:59.334792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:59.334719    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg" event={"ID":"daff83bb-e8d6-4452-b875-841be7fc151f","Type":"ContainerStarted","Data":"0d85c9923e20bd36d28581a6ea6ff593808a10ce763ec4afae1636feb772b527"}
Oct 30 07:05:59.440871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:05:59.440831    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"]
Oct 30 07:05:59.441985 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:05:59.441958    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab757f1_7257_4c8b_9000_4d4d39d7e338.slice/crio-d5bc912f5c924c8519eada8ffd463cbef797d3d81af75200bab87244d135b01c WatchSource:0}: Error finding container d5bc912f5c924c8519eada8ffd463cbef797d3d81af75200bab87244d135b01c: Status 404 returned error can't find the container with id d5bc912f5c924c8519eada8ffd463cbef797d3d81af75200bab87244d135b01c
Oct 30 07:06:00.341825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.341767    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg" event={"ID":"daff83bb-e8d6-4452-b875-841be7fc151f","Type":"ContainerStarted","Data":"3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b"}
Oct 30 07:06:00.342020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.341872    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:06:00.343554 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.343523    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5" event={"ID":"aab757f1-7257-4c8b-9000-4d4d39d7e338","Type":"ContainerStarted","Data":"7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641"}
Oct 30 07:06:00.343671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.343562    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5" event={"ID":"aab757f1-7257-4c8b-9000-4d4d39d7e338","Type":"ContainerStarted","Data":"d5bc912f5c924c8519eada8ffd463cbef797d3d81af75200bab87244d135b01c"}
Oct 30 07:06:00.343671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.343613    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:06:00.384870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.384798    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg" podStartSLOduration=2.056857791 podStartE2EDuration="2.384779464s" totalImagesPullingTime="327.921673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:00.382673561 +0000 UTC m=+563.090553729" watchObservedRunningTime="2026-10-30 07:06:00.384779464 +0000 UTC m=+563.092659634"
Oct 30 07:06:00.422840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:00.422790    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5" podStartSLOduration=2.422775126 podStartE2EDuration="2.422775126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:00.421176922 +0000 UTC m=+563.129057091" watchObservedRunningTime="2026-10-30 07:06:00.422775126 +0000 UTC m=+563.130655294"
Oct 30 07:06:01.324870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:01.323948    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:06:02.627874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.605557    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"]
Oct 30 07:06:02.655335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.655304    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"]
Oct 30 07:06:02.655707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.655612    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.657548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.657522    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.657767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.657744    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvwt\" (UniqueName: \"kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.657965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.657946    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.658140 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.658094    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.720029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.719370    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a1a08662-serving-cert\""
Oct 30 07:06:02.761826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.761787    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvwt\" (UniqueName: \"kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.762040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.761879    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.762040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.761905    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.762040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.761951    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.762238 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:02.762033    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-serving-cert: secret "maas-api-e2e-ait-a1a08662-serving-cert" not found
Oct 30 07:06:02.762238 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:02.762108    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls podName:9f50d3d1-99d3-4d72-bb56-8b7380773ee6 nodeName:}" failed. No retries permitted until 2026-10-30 07:06:03.262087348 +0000 UTC m=+565.969967496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls") pod "maas-api-e2e-ait-a1a08662-7b55c78848-h667r" (UID: "9f50d3d1-99d3-4d72-bb56-8b7380773ee6") : secret "maas-api-e2e-ait-a1a08662-serving-cert" not found
Oct 30 07:06:02.762888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.762637    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.764648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.764623    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:02.833309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:02.833240    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvwt\" (UniqueName: \"kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:03.269727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:03.269695    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:03.330876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:03.328522    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\") pod \"maas-api-e2e-ait-a1a08662-7b55c78848-h667r\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:03.621931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:03.621069    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:04.037827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:04.037279    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"]
Oct 30 07:06:04.459748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:04.459718    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r" event={"ID":"9f50d3d1-99d3-4d72-bb56-8b7380773ee6","Type":"ContainerStarted","Data":"e56a3a36a7b3d44a2072d7152050df0b4fdc9cbacfcd64baea237689aa6fda01"}
Oct 30 07:06:05.469148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:05.468554    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r" event={"ID":"9f50d3d1-99d3-4d72-bb56-8b7380773ee6","Type":"ContainerStarted","Data":"e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64"}
Oct 30 07:06:05.469148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:05.468628    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:05.532325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:05.530845    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r" podStartSLOduration=3.135483315 podStartE2EDuration="3.530827362s" totalImagesPullingTime="395.344047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:05.528152438 +0000 UTC m=+568.236032628" watchObservedRunningTime="2026-10-30 07:06:05.530827362 +0000 UTC m=+568.238707532"
Oct 30 07:06:06.448113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:06.448083    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:06:11.446677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:11.446539    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:06:11.551941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:11.535920    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:12.566206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:12.565958    5073 generic.go:356] "Generic (PLEG): container finished" podID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerID="41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d" exitCode=0
Oct 30 07:06:12.566206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:12.566030    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" event={"ID":"e38b54d8-5348-4d08-9b47-65b50d35605e","Type":"ContainerDied","Data":"41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"}
Oct 30 07:06:12.569201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:12.566552    5073 scope.go:122] "RemoveContainer" containerID="41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"
Oct 30 07:06:12.569201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:12.567905    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:12.569201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:12.567970    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:12.569201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:12.568004    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:13.590878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.590113    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" event={"ID":"e38b54d8-5348-4d08-9b47-65b50d35605e","Type":"ContainerStarted","Data":"668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3"}
Oct 30 07:06:13.594277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.594248    5073 generic.go:356] "Generic (PLEG): container finished" podID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerID="a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e" exitCode=0
Oct 30 07:06:13.594476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.594457    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" event={"ID":"fbdcb8fd-130f-4cf2-b11a-1fd9534824de","Type":"ContainerDied","Data":"a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"}
Oct 30 07:06:13.600148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.600126    5073 scope.go:122] "RemoveContainer" containerID="a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"
Oct 30 07:06:13.602367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.602334    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:13.603013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.602990    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:13.603172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:13.603154    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:14.114874 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:14.111880    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:06:14.543872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:14.541937    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:06:14.543872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:14.542130    5073 patch_prober.go:29] interesting pod/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 07:06:14.543872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:14.542193    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 07:06:14.726876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:14.726237    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" event={"ID":"fbdcb8fd-130f-4cf2-b11a-1fd9534824de","Type":"ContainerStarted","Data":"f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4"}
Oct 30 07:06:15.284877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:15.259868    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 30 07:06:15.284877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:15.259944    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 30 07:06:15.284877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:15.260273    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:06:15.582394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:15.582302    5073 patch_prober.go:29] interesting pod/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 07:06:15.706882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:15.706821    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 07:06:16.260327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:16.260289    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 30 07:06:16.260984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:16.260932    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 30 07:06:16.625942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:16.624962    5073 patch_prober.go:29] interesting pod/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 07:06:16.625942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:16.625027    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 07:06:17.258873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:17.258269    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 30 07:06:17.258873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:17.258336    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 30 07:06:17.535875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:17.535701    5073 patch_prober.go:29] interesting pod/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 07:06:17.535875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:17.535769    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 07:06:18.255119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:18.255079    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 30 07:06:18.255311 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:18.255138    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 30 07:06:18.535259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:18.535168    5073 patch_prober.go:29] interesting pod/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 07:06:18.535259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:18.535220    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 07:06:19.255576 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:19.255533    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 30 07:06:19.256172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:19.256139    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 30 07:06:19.535574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:19.535483    5073 patch_prober.go:29] interesting pod/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 07:06:19.535742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:19.535570    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 07:06:20.255870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:20.255354    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 30 07:06:20.255870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:20.255413    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 30 07:06:20.540121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:20.540042    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:06:20.540968 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:20.540899    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:06:20.541570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:20.541534    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:06:21.260771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:21.260730    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:06:21.261313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:21.261097    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:06:21.261983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:21.261964    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:06:22.315083 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.315044    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:06:22.315579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.315110    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:06:22.880560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.880528    5073 generic.go:356] "Generic (PLEG): container finished" podID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerID="4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3" exitCode=0
Oct 30 07:06:22.891793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.880596    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" event={"ID":"20345eaf-ee37-4638-a965-dd76ec2ce108","Type":"ContainerDied","Data":"4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"}
Oct 30 07:06:22.891793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.881148    5073 scope.go:122] "RemoveContainer" containerID="4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"
Oct 30 07:06:22.891793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.882801    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:22.891793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.882989    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:22.891793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:22.883116    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:23.286721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.286629    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:23.914492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.914456    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" event={"ID":"20345eaf-ee37-4638-a965-dd76ec2ce108","Type":"ContainerStarted","Data":"2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3"}
Oct 30 07:06:23.917051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.917021    5073 generic.go:356] "Generic (PLEG): container finished" podID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerID="7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800" exitCode=0
Oct 30 07:06:23.917208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.917055    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" event={"ID":"e935b98f-05c0-422a-8393-73bfe1ca97a3","Type":"ContainerDied","Data":"7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"}
Oct 30 07:06:23.917475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.917459    5073 scope.go:122] "RemoveContainer" containerID="7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"
Oct 30 07:06:23.919013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.918981    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:23.919092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.919071    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:23.919131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:23.919120    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:24.857650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:24.857619    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:24.858946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:24.858923    5073 patch_prober.go:29] interesting pod/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 07:06:24.859011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:24.858969    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 07:06:24.932686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:24.931105    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"]
Oct 30 07:06:24.932686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:24.931339    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn" podUID="b32cacd2-5e67-4c4b-9318-82c3259e788e" containerName="maas-api" containerID="cri-o://4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28" gracePeriod=30
Oct 30 07:06:24.945568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:24.944396    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" event={"ID":"e935b98f-05c0-422a-8393-73bfe1ca97a3","Type":"ContainerStarted","Data":"805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846"}
Oct 30 07:06:25.105714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.105250    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:06:25.105714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.105382    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 07:06:25.105714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.105441    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 07:06:25.360754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.360726    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:06:25.433879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.433109    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca\") pod \"b32cacd2-5e67-4c4b-9318-82c3259e788e\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") "
Oct 30 07:06:25.433879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.433178    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs\") pod \"b32cacd2-5e67-4c4b-9318-82c3259e788e\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") "
Oct 30 07:06:25.433879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.433270    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d\" (UniqueName: \"kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d\") pod \"b32cacd2-5e67-4c4b-9318-82c3259e788e\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") "
Oct 30 07:06:25.433879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.433378    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls\") pod \"b32cacd2-5e67-4c4b-9318-82c3259e788e\" (UID: \"b32cacd2-5e67-4c4b-9318-82c3259e788e\") "
Oct 30 07:06:25.434354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.434320    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca" pod "b32cacd2-5e67-4c4b-9318-82c3259e788e" (UID: "b32cacd2-5e67-4c4b-9318-82c3259e788e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:25.438470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.438432    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls" pod "b32cacd2-5e67-4c4b-9318-82c3259e788e" (UID: "b32cacd2-5e67-4c4b-9318-82c3259e788e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:06:25.439598 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.439115    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d" pod "b32cacd2-5e67-4c4b-9318-82c3259e788e" (UID: "b32cacd2-5e67-4c4b-9318-82c3259e788e"). InnerVolumeSpecName "kube-api-access-jsj8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:25.439727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.439616    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs" pod "b32cacd2-5e67-4c4b-9318-82c3259e788e" (UID: "b32cacd2-5e67-4c4b-9318-82c3259e788e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:06:25.534414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.534338    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:25.534414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.534367    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsj8d\" (UniqueName: \"kubernetes.io/projected/b32cacd2-5e67-4c4b-9318-82c3259e788e-kube-api-access-jsj8d\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:25.534414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.534378    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b32cacd2-5e67-4c4b-9318-82c3259e788e-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:25.534414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.534386    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b32cacd2-5e67-4c4b-9318-82c3259e788e-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:25.858684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.858606    5073 patch_prober.go:29] interesting pod/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 07:06:25.858684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.858673    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 07:06:25.943918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.943876    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"]
Oct 30 07:06:25.944396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.944120    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy" containerID="cri-o://668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3" gracePeriod=30
Oct 30 07:06:25.957424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.949910    5073 generic.go:356] "Generic (PLEG): container finished" podID="b32cacd2-5e67-4c4b-9318-82c3259e788e" containerID="4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28" exitCode=0
Oct 30 07:06:25.957424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.950587    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"
Oct 30 07:06:25.957424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.950931    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn" event={"ID":"b32cacd2-5e67-4c4b-9318-82c3259e788e","Type":"ContainerDied","Data":"4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28"}
Oct 30 07:06:25.957424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.950968    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn" event={"ID":"b32cacd2-5e67-4c4b-9318-82c3259e788e","Type":"ContainerDied","Data":"a5dac17d501914c8965ccc603343a264ab8cfeb7bcd8abaa4b008e2389160ab3"}
Oct 30 07:06:25.957424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.950988    5073 scope.go:122] "RemoveContainer" containerID="4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28"
Oct 30 07:06:25.982111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.982088    5073 scope.go:122] "RemoveContainer" containerID="4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28"
Oct 30 07:06:25.982675 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:25.982595    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28\": container with ID starting with 4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28 not found: ID does not exist" containerID="4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28"
Oct 30 07:06:25.982675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:25.982630    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28"} err="failed to get container status \"4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28\": rpc error: code = NotFound desc = could not find container \"4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28\": container with ID starting with 4ec0e448d1fed76b6b8bc48ebf24df69b506a34dd5aa3facc11bc92ab2f0ed28 not found: ID does not exist"
Oct 30 07:06:26.114932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:26.112392    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 07:06:26.114932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:26.112461    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 07:06:26.161961 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:26.161920    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"]
Oct 30 07:06:26.166438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:26.166408    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-414c5686-59578c8dc7-4r5bn"]
Oct 30 07:06:26.858386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:26.858352    5073 patch_prober.go:29] interesting pod/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 07:06:26.858561 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:26.858404    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 07:06:27.111938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:27.111255    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 07:06:27.111938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:27.111321    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 07:06:27.466321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:27.466289    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b32cacd2-5e67-4c4b-9318-82c3259e788e" path="/var/lib/kubelet/pods/b32cacd2-5e67-4c4b-9318-82c3259e788e/volumes"
Oct 30 07:06:27.858467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:27.858382    5073 patch_prober.go:29] interesting pod/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 07:06:27.858608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:27.858469    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 07:06:28.103307 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:28.103265    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 07:06:28.103558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:28.103527    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 07:06:28.858619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:28.858517    5073 patch_prober.go:29] interesting pod/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 07:06:28.858619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:28.858600    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 07:06:29.103306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:29.103266    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 07:06:29.103572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:29.103543    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 07:06:29.862408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:29.862377    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:29.862890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:29.862759    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:29.863557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:29.863537    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:30.103835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:30.103468    5073 patch_prober.go:29] interesting pod/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 07:06:30.103835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:30.103533    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 07:06:31.108881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.108826    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:06:31.109378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.109358    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:06:31.110127 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.110108    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:06:31.214983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.214914    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:06:31.269394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269359    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269441    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269477    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269510    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269613    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269660    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269770    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269786    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:31.269951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269829    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.269951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.269885    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy\") pod \"e38b54d8-5348-4d08-9b47-65b50d35605e\" (UID: \"e38b54d8-5348-4d08-9b47-65b50d35605e\") "
Oct 30 07:06:31.270293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.270270    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:31.270386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.270323    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.270466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.270443    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:31.272924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.270757    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:31.272924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.271751    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:31.272924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.272129    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:06:31.272924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.272768    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:31.272924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.272879    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "kube-api-access-nlqwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:31.273747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.273719    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy" pod "e38b54d8-5348-4d08-9b47-65b50d35605e" (UID: "e38b54d8-5348-4d08-9b47-65b50d35605e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:31.370977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.370933    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.370977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.370964    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.370977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.370978    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.371258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.370990    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.371258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.371001    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlqwh\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-kube-api-access-nlqwh\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.371258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.371011    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.371258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.371019    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e38b54d8-5348-4d08-9b47-65b50d35605e-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.371258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.371034    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e38b54d8-5348-4d08-9b47-65b50d35605e-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:31.931779 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.931742    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"]
Oct 30 07:06:31.932118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.932058    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg" podUID="daff83bb-e8d6-4452-b875-841be7fc151f" containerName="maas-api" containerID="cri-o://3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b" gracePeriod=30
Oct 30 07:06:31.991237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.991199    5073 generic.go:356] "Generic (PLEG): container finished" podID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerID="668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3" exitCode=0
Oct 30 07:06:31.991440 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.991258    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"
Oct 30 07:06:31.991440 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.991277    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" event={"ID":"e38b54d8-5348-4d08-9b47-65b50d35605e","Type":"ContainerDied","Data":"668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3"}
Oct 30 07:06:31.991440 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.991347    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg" event={"ID":"e38b54d8-5348-4d08-9b47-65b50d35605e","Type":"ContainerDied","Data":"5ee6996cc76c5f29dd6551196136cd5d7b60762c932f81abb2a55e865ba5832b"}
Oct 30 07:06:31.991440 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:31.991377    5073 scope.go:122] "RemoveContainer" containerID="668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3"
Oct 30 07:06:32.044628 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.044600    5073 scope.go:122] "RemoveContainer" containerID="41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"
Oct 30 07:06:32.050200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.050173    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"]
Oct 30 07:06:32.056207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.056184    5073 scope.go:122] "RemoveContainer" containerID="668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3"
Oct 30 07:06:32.056510 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:32.056489    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3\": container with ID starting with 668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3 not found: ID does not exist" containerID="668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3"
Oct 30 07:06:32.056562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.056519    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3"} err="failed to get container status \"668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3\": rpc error: code = NotFound desc = could not find container \"668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3\": container with ID starting with 668d36e0a73fc48bb85fa664ec17902796a32c0ee2225073c1c4e138ec517ab3 not found: ID does not exist"
Oct 30 07:06:32.056562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.056540    5073 scope.go:122] "RemoveContainer" containerID="41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"
Oct 30 07:06:32.056825 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:32.056802    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d\": container with ID starting with 41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d not found: ID does not exist" containerID="41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"
Oct 30 07:06:32.056947 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.056829    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d"} err="failed to get container status \"41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d\": rpc error: code = NotFound desc = could not find container \"41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d\": container with ID starting with 41216d84348b40ce006a50ec676f343b4bb0bf9f1d4801f31ab324a9a6bd744d not found: ID does not exist"
Oct 30 07:06:32.060430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.060406    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-414c5686-gw-openshift-default-7dbbd9df85-snmhg"]
Oct 30 07:06:32.215126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.215046    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:06:32.280190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.280153    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca\") pod \"daff83bb-e8d6-4452-b875-841be7fc151f\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") "
Oct 30 07:06:32.280367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.280336    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh\" (UniqueName: \"kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh\") pod \"daff83bb-e8d6-4452-b875-841be7fc151f\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") "
Oct 30 07:06:32.280443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.280397    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls\") pod \"daff83bb-e8d6-4452-b875-841be7fc151f\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") "
Oct 30 07:06:32.280507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.280458    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs\") pod \"daff83bb-e8d6-4452-b875-841be7fc151f\" (UID: \"daff83bb-e8d6-4452-b875-841be7fc151f\") "
Oct 30 07:06:32.280577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.280542    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca" pod "daff83bb-e8d6-4452-b875-841be7fc151f" (UID: "daff83bb-e8d6-4452-b875-841be7fc151f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:32.280843 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.280822    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daff83bb-e8d6-4452-b875-841be7fc151f-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:32.282702 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.282676    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh" pod "daff83bb-e8d6-4452-b875-841be7fc151f" (UID: "daff83bb-e8d6-4452-b875-841be7fc151f"). InnerVolumeSpecName "kube-api-access-d2twh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:32.283035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.283014    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls" pod "daff83bb-e8d6-4452-b875-841be7fc151f" (UID: "daff83bb-e8d6-4452-b875-841be7fc151f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:06:32.283124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.283040    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs" pod "daff83bb-e8d6-4452-b875-841be7fc151f" (UID: "daff83bb-e8d6-4452-b875-841be7fc151f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:06:32.381668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.381632    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2twh\" (UniqueName: \"kubernetes.io/projected/daff83bb-e8d6-4452-b875-841be7fc151f-kube-api-access-d2twh\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:32.381668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.381666    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:32.381883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.381679    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daff83bb-e8d6-4452-b875-841be7fc151f-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:32.885731 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.885692    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"]
Oct 30 07:06:32.886213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886199    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy"
Oct 30 07:06:32.886258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886215    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy"
Oct 30 07:06:32.886258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886234    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b32cacd2-5e67-4c4b-9318-82c3259e788e" containerName="maas-api"
Oct 30 07:06:32.886258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886239    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b32cacd2-5e67-4c4b-9318-82c3259e788e" containerName="maas-api"
Oct 30 07:06:32.886356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886260    5073 cpu_manager.go:414] "containerMap: removing container" podUID="daff83bb-e8d6-4452-b875-841be7fc151f" containerName="maas-api"
Oct 30 07:06:32.886356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886266    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="daff83bb-e8d6-4452-b875-841be7fc151f" containerName="maas-api"
Oct 30 07:06:32.886356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886340    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="daff83bb-e8d6-4452-b875-841be7fc151f" containerName="maas-api"
Oct 30 07:06:32.886356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886350    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy"
Oct 30 07:06:32.886473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886358    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b32cacd2-5e67-4c4b-9318-82c3259e788e" containerName="maas-api"
Oct 30 07:06:32.886473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.886365    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy"
Oct 30 07:06:32.889942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.889923    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:32.909135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.909109    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-2eda2c\""
Oct 30 07:06:32.909275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.909182    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-2eda2c-dockercfg-mvxgc\""
Oct 30 07:06:32.910251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.910231    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"]
Oct 30 07:06:32.983193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.983158    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"]
Oct 30 07:06:32.983699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.983684    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy"
Oct 30 07:06:32.983753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.983701    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" containerName="istio-proxy"
Oct 30 07:06:32.987094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.987076    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:32.987296 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.987275    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:32.987369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:32.987341    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqmm\" (UniqueName: \"kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm\") pod \"payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:33.036625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.036589    5073 generic.go:356] "Generic (PLEG): container finished" podID="daff83bb-e8d6-4452-b875-841be7fc151f" containerID="3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b" exitCode=0
Oct 30 07:06:33.037686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.037662    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"
Oct 30 07:06:33.037994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.037958    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg" event={"ID":"daff83bb-e8d6-4452-b875-841be7fc151f","Type":"ContainerDied","Data":"3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b"}
Oct 30 07:06:33.038107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.038039    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg" event={"ID":"daff83bb-e8d6-4452-b875-841be7fc151f","Type":"ContainerDied","Data":"0d85c9923e20bd36d28581a6ea6ff593808a10ce763ec4afae1636feb772b527"}
Oct 30 07:06:33.038183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.038164    5073 scope.go:122] "RemoveContainer" containerID="3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b"
Oct 30 07:06:33.042823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.042691    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"]
Oct 30 07:06:33.064545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.064519    5073 scope.go:122] "RemoveContainer" containerID="3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b"
Oct 30 07:06:33.065071 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:33.065045    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b\": container with ID starting with 3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b not found: ID does not exist" containerID="3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b"
Oct 30 07:06:33.065200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.065083    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b"} err="failed to get container status \"3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b\": rpc error: code = NotFound desc = could not find container \"3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b\": container with ID starting with 3a357ca26c18a4a10670a17dd476f9c3af595b0328b2e5352a83bde2b9a6717b not found: ID does not exist"
Oct 30 07:06:33.088680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.088650    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wnw\" (UniqueName: \"kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw\") pod \"payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.088844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.088823    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.088936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.088905    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:33.089027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.089005    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drqmm\" (UniqueName: \"kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm\") pod \"payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:33.089632 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.089614    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:33.132819 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.132791    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"]
Oct 30 07:06:33.136689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.136641    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqmm\" (UniqueName: \"kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm\") pod \"payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:33.142795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.142769    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a9eddc5d-546cffcd58-4gjqg"]
Oct 30 07:06:33.190095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.190065    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.190269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.190177    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wnw\" (UniqueName: \"kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw\") pod \"payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.190928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.190908    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.191336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.191315    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"]
Oct 30 07:06:33.191544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.191520    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" containerID="cri-o://f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4" gracePeriod=30
Oct 30 07:06:33.203163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.203134    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:33.214649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.214631    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wnw\" (UniqueName: \"kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw\") pod \"payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.310884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.310258    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:33.423534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.423501    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="daff83bb-e8d6-4452-b875-841be7fc151f" path="/var/lib/kubelet/pods/daff83bb-e8d6-4452-b875-841be7fc151f/volumes"
Oct 30 07:06:33.423980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.423963    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e38b54d8-5348-4d08-9b47-65b50d35605e" path="/var/lib/kubelet/pods/e38b54d8-5348-4d08-9b47-65b50d35605e/volumes"
Oct 30 07:06:33.504720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.504693    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"]
Oct 30 07:06:33.504908 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:06:33.504885    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87421966_6131_48eb_a611_d1ac76a0d19f.slice/crio-454b394f5d49460af46523c426d6f40f5acd419d69734c1ebbae00b3b9beaebb WatchSource:0}: Error finding container 454b394f5d49460af46523c426d6f40f5acd419d69734c1ebbae00b3b9beaebb: Status 404 returned error can't find the container with id 454b394f5d49460af46523c426d6f40f5acd419d69734c1ebbae00b3b9beaebb
Oct 30 07:06:33.657870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:33.657825    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"]
Oct 30 07:06:33.657985 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:06:33.657937    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae630470_cbef_4780_9df6_27f416319e22.slice/crio-5e74dc3359ea8ce9919f3167c9a8d9a002cc1c91d27e033e9e4b4254a34be6aa WatchSource:0}: Error finding container 5e74dc3359ea8ce9919f3167c9a8d9a002cc1c91d27e033e9e4b4254a34be6aa: Status 404 returned error can't find the container with id 5e74dc3359ea8ce9919f3167c9a8d9a002cc1c91d27e033e9e4b4254a34be6aa
Oct 30 07:06:34.045561 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.045465    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" event={"ID":"ae630470-cbef-4780-9df6-27f416319e22","Type":"ContainerStarted","Data":"824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4"}
Oct 30 07:06:34.045732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.045668    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:34.045732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.045705    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" event={"ID":"ae630470-cbef-4780-9df6-27f416319e22","Type":"ContainerStarted","Data":"5e74dc3359ea8ce9919f3167c9a8d9a002cc1c91d27e033e9e4b4254a34be6aa"}
Oct 30 07:06:34.048059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.048027    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" event={"ID":"87421966-6131-48eb-a611-d1ac76a0d19f","Type":"ContainerStarted","Data":"4257121a21e705558c60db2404231aef689fb3fc4abf259bc5c04ea038f55cfa"}
Oct 30 07:06:34.048194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.048081    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" event={"ID":"87421966-6131-48eb-a611-d1ac76a0d19f","Type":"ContainerStarted","Data":"454b394f5d49460af46523c426d6f40f5acd419d69734c1ebbae00b3b9beaebb"}
Oct 30 07:06:34.048194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.048135    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:34.087318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.087261    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" podStartSLOduration=2.087245004 podStartE2EDuration="2.087245004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:34.086814011 +0000 UTC m=+596.794694180" watchObservedRunningTime="2026-10-30 07:06:34.087245004 +0000 UTC m=+596.795125174"
Oct 30 07:06:34.127868 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.127805    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" podStartSLOduration=2.1277913330000002 podStartE2EDuration="2.127791333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:34.126061278 +0000 UTC m=+596.833941446" watchObservedRunningTime="2026-10-30 07:06:34.127791333 +0000 UTC m=+596.835671502"
Oct 30 07:06:34.537100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.537062    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"]
Oct 30 07:06:34.541835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.541809    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.559137 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.559112    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-bb6be4-openshift-default-dockercfg-2kstl\""
Oct 30 07:06:34.566345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.566316    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"]
Oct 30 07:06:34.599709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.599680    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"]
Oct 30 07:06:34.600002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.599925    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r" podUID="9f50d3d1-99d3-4d72-bb56-8b7380773ee6" containerName="maas-api" containerID="cri-o://e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64" gracePeriod=30
Oct 30 07:06:34.604723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.604693    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.604873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.604755    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.607168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.604982    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.608698 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.608677    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.608914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.608894    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.609069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.609044    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krx6l\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.609215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.609124    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.609215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.609204    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.609328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.609228    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.710742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.710708    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.710742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.710740    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.710964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.710942    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711005    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711088    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711165 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711101    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711165 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711118    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711167    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711180    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711200    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krx6l\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711425 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711275    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711425 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711350    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711495    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.711598 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.711579    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.713486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.713465    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.713658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.713640    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.733971 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.733934    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.734325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.734303    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krx6l\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.862541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.862306    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:34.940705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:34.940199    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:35.020622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.019555    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs\") pod \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") "
Oct 30 07:06:35.020622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.019603    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt\" (UniqueName: \"kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt\") pod \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") "
Oct 30 07:06:35.020622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.019785    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca\") pod \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") "
Oct 30 07:06:35.020622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.019817    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\") pod \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\" (UID: \"9f50d3d1-99d3-4d72-bb56-8b7380773ee6\") "
Oct 30 07:06:35.021262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.021232    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca" pod "9f50d3d1-99d3-4d72-bb56-8b7380773ee6" (UID: "9f50d3d1-99d3-4d72-bb56-8b7380773ee6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:35.023434 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.023370    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt" pod "9f50d3d1-99d3-4d72-bb56-8b7380773ee6" (UID: "9f50d3d1-99d3-4d72-bb56-8b7380773ee6"). InnerVolumeSpecName "kube-api-access-hqvwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:35.023650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.023628    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs" pod "9f50d3d1-99d3-4d72-bb56-8b7380773ee6" (UID: "9f50d3d1-99d3-4d72-bb56-8b7380773ee6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:06:35.023757 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.023666    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls" pod "9f50d3d1-99d3-4d72-bb56-8b7380773ee6" (UID: "9f50d3d1-99d3-4d72-bb56-8b7380773ee6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:06:35.054927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.054844    5073 generic.go:356] "Generic (PLEG): container finished" podID="9f50d3d1-99d3-4d72-bb56-8b7380773ee6" containerID="e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64" exitCode=0
Oct 30 07:06:35.054927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.054888    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r" event={"ID":"9f50d3d1-99d3-4d72-bb56-8b7380773ee6","Type":"ContainerDied","Data":"e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64"}
Oct 30 07:06:35.055066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.054947    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r" event={"ID":"9f50d3d1-99d3-4d72-bb56-8b7380773ee6","Type":"ContainerDied","Data":"e56a3a36a7b3d44a2072d7152050df0b4fdc9cbacfcd64baea237689aa6fda01"}
Oct 30 07:06:35.055066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.054971    5073 scope.go:122] "RemoveContainer" containerID="e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64"
Oct 30 07:06:35.055066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.054901    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"
Oct 30 07:06:35.064955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.064938    5073 scope.go:122] "RemoveContainer" containerID="e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64"
Oct 30 07:06:35.065180 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:35.065160    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64\": container with ID starting with e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64 not found: ID does not exist" containerID="e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64"
Oct 30 07:06:35.065245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.065188    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64"} err="failed to get container status \"e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64\": rpc error: code = NotFound desc = could not find container \"e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64\": container with ID starting with e113a571147a9f04948f19befd4eda9689c533c9f4849a91ea2038a04ffdca64 not found: ID does not exist"
Oct 30 07:06:35.131026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.124137    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:35.131026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.124173    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqvwt\" (UniqueName: \"kubernetes.io/projected/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-kube-api-access-hqvwt\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:35.131026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.124191    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:35.131026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.124207    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f50d3d1-99d3-4d72-bb56-8b7380773ee6-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:35.131026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.125376    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"]
Oct 30 07:06:35.134798 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.134766    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1a08662-7b55c78848-h667r"]
Oct 30 07:06:35.233974 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.233945    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"]
Oct 30 07:06:35.234373 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:06:35.234350    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa733e26_9561_4b9c_a4eb_5ac0e927245b.slice/crio-319408a8b171ad836f569289ccfe3b67c7e954545f179b95b8125eda2a626107 WatchSource:0}: Error finding container 319408a8b171ad836f569289ccfe3b67c7e954545f179b95b8125eda2a626107: Status 404 returned error can't find the container with id 319408a8b171ad836f569289ccfe3b67c7e954545f179b95b8125eda2a626107
Oct 30 07:06:35.236580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.236553    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:35.236679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.236613    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:35.236679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.236642    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:35.429906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:35.429842    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f50d3d1-99d3-4d72-bb56-8b7380773ee6" path="/var/lib/kubelet/pods/9f50d3d1-99d3-4d72-bb56-8b7380773ee6/volumes"
Oct 30 07:06:36.062395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.062356    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" event={"ID":"aa733e26-9561-4b9c-a4eb-5ac0e927245b","Type":"ContainerStarted","Data":"3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"}
Oct 30 07:06:36.062816 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.062424    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" event={"ID":"aa733e26-9561-4b9c-a4eb-5ac0e927245b","Type":"ContainerStarted","Data":"319408a8b171ad836f569289ccfe3b67c7e954545f179b95b8125eda2a626107"}
Oct 30 07:06:36.129801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.129750    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podStartSLOduration=2.1297342009999998 podStartE2EDuration="2.129734201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:36.11657391 +0000 UTC m=+598.824454061" watchObservedRunningTime="2026-10-30 07:06:36.129734201 +0000 UTC m=+598.837614369"
Oct 30 07:06:36.263709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.263675    5073 patch_prober.go:29] interesting pod/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:06:36.263890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.263741    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:06:36.862499 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.862467    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:36.868009 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:36.867985    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:37.045424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.045390    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"]
Oct 30 07:06:37.045685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.045651    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy" containerID="cri-o://805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846" gracePeriod=30
Oct 30 07:06:37.069159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.069130    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:37.070248 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.070230    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:37.362370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.362334    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"]
Oct 30 07:06:37.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.362878    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9f50d3d1-99d3-4d72-bb56-8b7380773ee6" containerName="maas-api"
Oct 30 07:06:37.362951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.362894    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f50d3d1-99d3-4d72-bb56-8b7380773ee6" containerName="maas-api"
Oct 30 07:06:37.362991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.362978    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f50d3d1-99d3-4d72-bb56-8b7380773ee6" containerName="maas-api"
Oct 30 07:06:37.367299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.367282    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.381486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.381463    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.381590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.381515    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.381627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.381593    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9lb7\" (UniqueName: \"kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.381663 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.381626    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.385842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.385774    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-2eda2c-serving-cert\""
Oct 30 07:06:37.385995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.385982    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 07:06:37.386123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.386060    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lnjcd\""
Oct 30 07:06:37.387271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.387248    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"]
Oct 30 07:06:37.482346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.482318    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.482517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.482383    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.482517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.482431    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9lb7\" (UniqueName: \"kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.482517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.482474    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.482517 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:37.482491    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-serving-cert: secret "maas-api-e2e-worker-w3-2eda2c-serving-cert" not found
Oct 30 07:06:37.482755 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:37.482553    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls podName:e5b7e8c1-7376-4769-a059-4dd6d12b7d0c nodeName:}" failed. No retries permitted until 2026-10-30 07:06:37.982538604 +0000 UTC m=+600.690418752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls") pod "maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" (UID: "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c") : secret "maas-api-e2e-worker-w3-2eda2c-serving-cert" not found
Oct 30 07:06:37.483101 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.483076    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.485662 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.485628    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.501823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.501800    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:06:37.502724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.502706    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:06:37.507010 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.505641    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9lb7\" (UniqueName: \"kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.987128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.987091    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:37.989479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:37.989449    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:38.022211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.022180    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"]
Oct 30 07:06:38.283812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.283733    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:38.513681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.513656    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:06:38.593337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593258    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593335    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593390    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593436    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593495    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593543    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593593    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:38.593697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593608    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593638    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593685    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo\") pod \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\" (UID: \"fbdcb8fd-130f-4cf2-b11a-1fd9534824de\") "
Oct 30 07:06:38.593983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593702    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:38.593983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593753    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:38.593983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.593956    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:38.594130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.594046    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:38.594181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.594136    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.594181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.594155    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.594181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.594170    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.594319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.594184    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.594319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.594197    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.595932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.595907    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:06:38.596158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.596131    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:38.596316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.596298    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:38.596424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.596406    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg" pod "fbdcb8fd-130f-4cf2-b11a-1fd9534824de" (UID: "fbdcb8fd-130f-4cf2-b11a-1fd9534824de"). InnerVolumeSpecName "kube-api-access-rspkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:38.681207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.677703    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"]
Oct 30 07:06:38.695476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.695433    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.695476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.695467    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rspkg\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-kube-api-access-rspkg\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.695476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.695478    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:38.695476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:38.695487    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbdcb8fd-130f-4cf2-b11a-1fd9534824de-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:39.084130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.084095    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" event={"ID":"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c","Type":"ContainerStarted","Data":"002162a5f3077e2e0ed97fe583932e93cedf14afd627a7c898a9a55d20ab4adb"}
Oct 30 07:06:39.084262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.084160    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" event={"ID":"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c","Type":"ContainerStarted","Data":"c325a7011ff3d490ca24f575736ce2c23899fd1e00c52bd8783c074d33fd1321"}
Oct 30 07:06:39.084336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.084312    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:39.085941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.085912    5073 generic.go:356] "Generic (PLEG): container finished" podID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerID="f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4" exitCode=0
Oct 30 07:06:39.086029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.085949    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" event={"ID":"fbdcb8fd-130f-4cf2-b11a-1fd9534824de","Type":"ContainerDied","Data":"f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4"}
Oct 30 07:06:39.086029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.085975    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"
Oct 30 07:06:39.086029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.086001    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf" event={"ID":"fbdcb8fd-130f-4cf2-b11a-1fd9534824de","Type":"ContainerDied","Data":"c01b0e5f05f96b1f181f456c3cdc10a863f9ae0d5fd0ba5d38826cbeffa14d8d"}
Oct 30 07:06:39.086144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.086029    5073 scope.go:122] "RemoveContainer" containerID="f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4"
Oct 30 07:06:39.097043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.097022    5073 scope.go:122] "RemoveContainer" containerID="a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"
Oct 30 07:06:39.106301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.106276    5073 scope.go:122] "RemoveContainer" containerID="f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4"
Oct 30 07:06:39.106561 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:39.106541    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4\": container with ID starting with f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4 not found: ID does not exist" containerID="f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4"
Oct 30 07:06:39.106617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.106569    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4"} err="failed to get container status \"f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4\": rpc error: code = NotFound desc = could not find container \"f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4\": container with ID starting with f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4 not found: ID does not exist"
Oct 30 07:06:39.106617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.106587    5073 scope.go:122] "RemoveContainer" containerID="a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"
Oct 30 07:06:39.106803 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:39.106787    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e\": container with ID starting with a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e not found: ID does not exist" containerID="a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"
Oct 30 07:06:39.106844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.106809    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e"} err="failed to get container status \"a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e\": rpc error: code = NotFound desc = could not find container \"a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e\": container with ID starting with a6b249175cdc4a8af89c8157d90d5d9e79423b9f9be443f72702c11fefbb4f1e not found: ID does not exist"
Oct 30 07:06:39.127780 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.127733    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" podStartSLOduration=1.797515321 podStartE2EDuration="2.127721225s" totalImagesPullingTime="330.205904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:39.125799643 +0000 UTC m=+601.833679824" watchObservedRunningTime="2026-10-30 07:06:39.127721225 +0000 UTC m=+601.835601411"
Oct 30 07:06:39.164609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.164584    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"]
Oct 30 07:06:39.168903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.168882    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a9eddc5d-openshift-default-665c9b8847-6crdf"]
Oct 30 07:06:39.421780 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:39.421749    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" path="/var/lib/kubelet/pods/fbdcb8fd-130f-4cf2-b11a-1fd9534824de/volumes"
Oct 30 07:06:40.833551 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.833517    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"]
Oct 30 07:06:40.834051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.834036    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy"
Oct 30 07:06:40.834095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.834051    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy"
Oct 30 07:06:40.834095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.834073    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy"
Oct 30 07:06:40.834095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.834078    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy"
Oct 30 07:06:40.834197 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.834173    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy"
Oct 30 07:06:40.839318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.839297    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:40.859639 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.859612    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"]
Oct 30 07:06:40.867945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.867919    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-bb6be4-dockercfg-j2nvx\""
Oct 30 07:06:40.868084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.868038    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-bb6be4\""
Oct 30 07:06:40.928786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.928751    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"]
Oct 30 07:06:40.929391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.929369    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbdcb8fd-130f-4cf2-b11a-1fd9534824de" containerName="istio-proxy"
Oct 30 07:06:40.932866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.932834    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:40.935906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.935842    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:40.936038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.936013    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfk8p\" (UniqueName: \"kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p\") pod \"payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:40.953976 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:40.953953    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"]
Oct 30 07:06:41.037772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.037737    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jscd7\" (UniqueName: \"kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7\") pod \"payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.037976 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.037860    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:41.037976 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.037945    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.038107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.037978    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfk8p\" (UniqueName: \"kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p\") pod \"payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:41.038594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.038568    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:41.064216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.064188    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfk8p\" (UniqueName: \"kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p\") pod \"payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:41.139712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.139676    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jscd7\" (UniqueName: \"kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7\") pod \"payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.139910 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.139785    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.140526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.140502    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.153480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.153453    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:41.163348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.163324    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jscd7\" (UniqueName: \"kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7\") pod \"payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.251344 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.248937    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:41.428776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.427350    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"]
Oct 30 07:06:41.428776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.427537    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" containerID="cri-o://2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3" gracePeriod=30
Oct 30 07:06:41.503744 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.503697    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"]
Oct 30 07:06:41.615103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:41.615078    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"]
Oct 30 07:06:42.117465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.117417    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" event={"ID":"58d2e1af-ea71-4540-b85c-158dca17fa50","Type":"ContainerStarted","Data":"dab5fdc88bb974023bfde4a7393d0fc8cb81b96459e6a703d10c68b1c2ecabf5"}
Oct 30 07:06:42.117994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.117641    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:42.117994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.117686    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" event={"ID":"58d2e1af-ea71-4540-b85c-158dca17fa50","Type":"ContainerStarted","Data":"797dbd54bd7fa751910d2b0860a45aa1afaf8486210c16c4c713e340d04a171b"}
Oct 30 07:06:42.120646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.120618    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" event={"ID":"0491151e-4c57-4f97-a109-0f9c41917f82","Type":"ContainerStarted","Data":"39aaff95f826ca8671264f06784d9b32902a4ed754a713f2c7d1fec7ea7d2439"}
Oct 30 07:06:42.120795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.120657    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" event={"ID":"0491151e-4c57-4f97-a109-0f9c41917f82","Type":"ContainerStarted","Data":"39f7aeefb719da198754c45059ca210170f49d4a070341ec3e02b662cb9b3b3d"}
Oct 30 07:06:42.120795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.120677    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:42.151964 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:42.151926    5073 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa733e26_9561_4b9c_a4eb_5ac0e927245b.slice/crio-319408a8b171ad836f569289ccfe3b67c7e954545f179b95b8125eda2a626107\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdcb8fd_130f_4cf2_b11a_1fd9534824de.slice/crio-f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdcb8fd_130f_4cf2_b11a_1fd9534824de.slice/crio-conmon-f5aaa7aa1e8f9b4935d318f83a54a77eed980a2c84c145c0ba4af49ed60f6de4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode935b98f_05c0_422a_8393_73bfe1ca97a3.slice/crio-8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d\": RecentStats: unable to find data in memory cache]"
Oct 30 07:06:42.157755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.157711    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" podStartSLOduration=2.157698445 podStartE2EDuration="2.157698445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:42.156306659 +0000 UTC m=+604.864186828" watchObservedRunningTime="2026-10-30 07:06:42.157698445 +0000 UTC m=+604.865578613"
Oct 30 07:06:42.197053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.196997    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" podStartSLOduration=2.196982071 podStartE2EDuration="2.196982071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:42.194486925 +0000 UTC m=+604.902367095" watchObservedRunningTime="2026-10-30 07:06:42.196982071 +0000 UTC m=+604.904862239"
Oct 30 07:06:42.329665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.329602    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:06:42.360004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.359975    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360021    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360061    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360106    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360126    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360161    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360228    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:42.360369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360269    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360295    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360362    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token\") pod \"e935b98f-05c0-422a-8393-73bfe1ca97a3\" (UID: \"e935b98f-05c0-422a-8393-73bfe1ca97a3\") "
Oct 30 07:06:42.360627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360388    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:42.360627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360498    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:42.360627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360618    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:42.360772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360638    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:42.360884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.360847    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.361030 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.361007    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.361120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.361030    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.361120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.361045    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e935b98f-05c0-422a-8393-73bfe1ca97a3-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.361120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.361053    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.362542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.362518    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "kube-api-access-q65cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:42.362612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.362552    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:42.362731 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.362717    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:42.362783 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.362736    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo" pod "e935b98f-05c0-422a-8393-73bfe1ca97a3" (UID: "e935b98f-05c0-422a-8393-73bfe1ca97a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:06:42.462006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.461974    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.462006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.462002    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.462006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.462011    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e935b98f-05c0-422a-8393-73bfe1ca97a3-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.462218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.462019    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q65cb\" (UniqueName: \"kubernetes.io/projected/e935b98f-05c0-422a-8393-73bfe1ca97a3-kube-api-access-q65cb\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:42.836138 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.836104    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"]
Oct 30 07:06:42.836900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.836879    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy"
Oct 30 07:06:42.836900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.836898    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy"
Oct 30 07:06:42.837076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.836958    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy"
Oct 30 07:06:42.837076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.836966    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy"
Oct 30 07:06:42.837076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.837072    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy"
Oct 30 07:06:42.841197 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.841175    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.862331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.862307    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-4fe2ed-openshift-default-dockercfg-s6hbq\""
Oct 30 07:06:42.876435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.876410    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"]
Oct 30 07:06:42.966802 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.966770    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.966973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.966825    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.966973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.966933    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.967051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.966975    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.967051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.967025    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.967125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.967060    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.967125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.967092    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnwh\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.967182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.967140    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:42.967215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:42.967184    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.023351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.023300    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5" podUID="aab757f1-7257-4c8b-9000-4d4d39d7e338" containerName="payload-pre-processing" containerID="cri-o://7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641" gracePeriod=25
Oct 30 07:06:43.068498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.068465    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnwh\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.068650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.068517    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069495    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069636    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069728 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069713    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069748    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069781    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069810    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.069925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.069885    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.070282 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.070263    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.070537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.070511    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.070998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.070979    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.071204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.071183    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.073549 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.073499    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.074595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.074551    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.075007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.074959    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.075460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.075414    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"]
Oct 30 07:06:43.076479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.076454    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerName="istio-proxy"
Oct 30 07:06:43.085211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.085178    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.101264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.100983    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnwh\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.103757 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.103715    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-bb6be4-serving-cert\""
Oct 30 07:06:43.104267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.104249    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.105430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.105122    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"]
Oct 30 07:06:43.153761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.152577    5073 generic.go:356] "Generic (PLEG): container finished" podID="e935b98f-05c0-422a-8393-73bfe1ca97a3" containerID="805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846" exitCode=0
Oct 30 07:06:43.153761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.152794    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" event={"ID":"e935b98f-05c0-422a-8393-73bfe1ca97a3","Type":"ContainerDied","Data":"805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846"}
Oct 30 07:06:43.153761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.152865    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x" event={"ID":"e935b98f-05c0-422a-8393-73bfe1ca97a3","Type":"ContainerDied","Data":"8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d"}
Oct 30 07:06:43.153761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.152897    5073 scope.go:122] "RemoveContainer" containerID="805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846"
Oct 30 07:06:43.153761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.153034    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"
Oct 30 07:06:43.159383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.159360    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:43.181135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.165504    5073 generic.go:356] "Generic (PLEG): container finished" podID="aab757f1-7257-4c8b-9000-4d4d39d7e338" containerID="7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641" exitCode=0
Oct 30 07:06:43.181135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.165605    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5" event={"ID":"aab757f1-7257-4c8b-9000-4d4d39d7e338","Type":"ContainerDied","Data":"7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641"}
Oct 30 07:06:43.181135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.174903    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.181135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.174952    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srkv8\" (UniqueName: \"kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.181135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.175047    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.181135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.175098    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.186555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.186532    5073 scope.go:122] "RemoveContainer" containerID="7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"
Oct 30 07:06:43.210617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.209971    5073 scope.go:122] "RemoveContainer" containerID="805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846"
Oct 30 07:06:43.210617 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:43.210278    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846\": container with ID starting with 805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846 not found: ID does not exist" containerID="805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846"
Oct 30 07:06:43.210617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.210307    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846"} err="failed to get container status \"805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846\": rpc error: code = NotFound desc = could not find container \"805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846\": container with ID starting with 805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846 not found: ID does not exist"
Oct 30 07:06:43.210617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.210327    5073 scope.go:122] "RemoveContainer" containerID="7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"
Oct 30 07:06:43.210617 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:43.210550    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800\": container with ID starting with 7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800 not found: ID does not exist" containerID="7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"
Oct 30 07:06:43.210617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.210573    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800"} err="failed to get container status \"7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800\": rpc error: code = NotFound desc = could not find container \"7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800\": container with ID starting with 7c708e6cb03442662c9a288ee85aebf1c897b9f9b0273513760d56f53e848800 not found: ID does not exist"
Oct 30 07:06:43.255017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.254988    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"]
Oct 30 07:06:43.257517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.257490    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a1a08662-openshift-default-568f48c66c-t6k7x"]
Oct 30 07:06:43.277226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.276530    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.277226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.276636    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srkv8\" (UniqueName: \"kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.277226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.276688    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.277226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.276769    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.280130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.280098    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.282075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.282049    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.282577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.282558    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.303229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.303200    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srkv8\" (UniqueName: \"kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8\") pod \"maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.317714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.317689    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:06:43.399743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.399705    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59\" (UniqueName: \"kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59\") pod \"aab757f1-7257-4c8b-9000-4d4d39d7e338\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") "
Oct 30 07:06:43.411302 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.411269    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume\") pod \"aab757f1-7257-4c8b-9000-4d4d39d7e338\" (UID: \"aab757f1-7257-4c8b-9000-4d4d39d7e338\") "
Oct 30 07:06:43.412672 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.412611    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume" pod "aab757f1-7257-4c8b-9000-4d4d39d7e338" (UID: "aab757f1-7257-4c8b-9000-4d4d39d7e338"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:43.413271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.413247    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59" pod "aab757f1-7257-4c8b-9000-4d4d39d7e338" (UID: "aab757f1-7257-4c8b-9000-4d4d39d7e338"). InnerVolumeSpecName "kube-api-access-22p59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:43.427764 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.427727    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e935b98f-05c0-422a-8393-73bfe1ca97a3" path="/var/lib/kubelet/pods/e935b98f-05c0-422a-8393-73bfe1ca97a3/volumes"
Oct 30 07:06:43.466097 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.466073    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:43.512886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.512844    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22p59\" (UniqueName: \"kubernetes.io/projected/aab757f1-7257-4c8b-9000-4d4d39d7e338-kube-api-access-22p59\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:43.512960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.512891    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab757f1-7257-4c8b-9000-4d4d39d7e338-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:43.518162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.517688    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"]
Oct 30 07:06:43.518588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.518559    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:43.518679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.518631    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:43.518736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.518675    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:43.774134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:43.774106    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"]
Oct 30 07:06:43.922007 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:43.921969    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:06:44.172559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.172525    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f" event={"ID":"75931c81-5679-447e-bdb2-d29caf32830b","Type":"ContainerStarted","Data":"5acf092d631837a74e640a9e741649118283a615f5fd6991ab8334c9e3078747"}
Oct 30 07:06:44.174212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.174176    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" event={"ID":"6db2a540-2696-4277-89f3-27012f35f846","Type":"ContainerStarted","Data":"0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"}
Oct 30 07:06:44.174332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.174224    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" event={"ID":"6db2a540-2696-4277-89f3-27012f35f846","Type":"ContainerStarted","Data":"4af04dbf755afbc86bf9a3d8bd0ffc88e5f1c94c79d986cd3878c9d23b32e714"}
Oct 30 07:06:44.175573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.175552    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"
Oct 30 07:06:44.175682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.175600    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5" event={"ID":"aab757f1-7257-4c8b-9000-4d4d39d7e338","Type":"ContainerDied","Data":"d5bc912f5c924c8519eada8ffd463cbef797d3d81af75200bab87244d135b01c"}
Oct 30 07:06:44.175682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.175669    5073 scope.go:122] "RemoveContainer" containerID="7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641"
Oct 30 07:06:44.220398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.220342    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podStartSLOduration=2.2203274889999998 podStartE2EDuration="2.220327489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:44.217591197 +0000 UTC m=+606.925471366" watchObservedRunningTime="2026-10-30 07:06:44.220327489 +0000 UTC m=+606.928207719"
Oct 30 07:06:44.253821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.253793    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"]
Oct 30 07:06:44.257642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.257618    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b764790-bfd57c4c-58bc5"]
Oct 30 07:06:44.865282 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.865232    5073 patch_prober.go:29] interesting pod/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:06:44.865494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:44.865300    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:06:45.058029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.057997    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 07:06:45.058172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.058066    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 07:06:45.098919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.098881    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 07:06:45.164261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.164228    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:45.169636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.169610    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:45.186183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.186151    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f" event={"ID":"75931c81-5679-447e-bdb2-d29caf32830b","Type":"ContainerStarted","Data":"6b5bbc39948763d9c79ea8e6818d4129ddce9ee0b55ab44d2209962c57830bb6"}
Oct 30 07:06:45.186545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.186292    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:45.187172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.187150    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:06:45.311151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.311099    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f" podStartSLOduration=1.907302681 podStartE2EDuration="2.311084831s" totalImagesPullingTime="403.78215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:45.310592978 +0000 UTC m=+608.018473158" watchObservedRunningTime="2026-10-30 07:06:45.311084831 +0000 UTC m=+608.018964999"
Oct 30 07:06:45.422303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:45.422236    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aab757f1-7257-4c8b-9000-4d4d39d7e338" path="/var/lib/kubelet/pods/aab757f1-7257-4c8b-9000-4d4d39d7e338/volumes"
Oct 30 07:06:46.192241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.192214    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:46.600838 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:46.600784    5073 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode935b98f_05c0_422a_8393_73bfe1ca97a3.slice/crio-conmon-805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20345eaf_ee37_4638_a965_dd76ec2ce108.slice/crio-conmon-2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab757f1_7257_4c8b_9000_4d4d39d7e338.slice/crio-7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode935b98f_05c0_422a_8393_73bfe1ca97a3.slice/crio-805125aa8307679033f61d032f8478fb509911d7ec22fc8d65e685c6817f2846.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab757f1_7257_4c8b_9000_4d4d39d7e338.slice/crio-conmon-7564ae71966190664a51ce0d4b610ac16b52e9975d14fa1881fd38767f20d641.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab757f1_7257_4c8b_9000_4d4d39d7e338.slice/crio-d5bc912f5c924c8519eada8ffd463cbef797d3d81af75200bab87244d135b01c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20345eaf_ee37_4638_a965_dd76ec2ce108.slice/crio-2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode935b98f_05c0_422a_8393_73bfe1ca97a3.slice/crio-8c252a897f8eaede0ce50429cccc6d3438e6170adc5e65b95d4b6007c713372d\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode935b98f_05c0_422a_8393_73bfe1ca97a3.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab757f1_7257_4c8b_9000_4d4d39d7e338.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 07:06:46.711392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.711335    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:46.854596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854563    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.854736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854647    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.854736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854676    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.854736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854728    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.854888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854788    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.854944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854879    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:46.854944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854917    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.855049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.854957    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.855100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855073    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.855100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855080    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:46.855199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855082    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:06:46.855199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855109    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:46.855199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855144    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo\") pod \"20345eaf-ee37-4638-a965-dd76ec2ce108\" (UID: \"20345eaf-ee37-4638-a965-dd76ec2ce108\") "
Oct 30 07:06:46.855199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855175    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:46.855563 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855540    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.855673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855567    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.855673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855583    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20345eaf-ee37-4638-a965-dd76ec2ce108-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.855673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855599    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.855673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.855612    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.857219 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.857196    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:06:46.857431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.857365    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:06:46.857431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.857421    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:46.857531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.857448    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5" pod "20345eaf-ee37-4638-a965-dd76ec2ce108" (UID: "20345eaf-ee37-4638-a965-dd76ec2ce108"). InnerVolumeSpecName "kube-api-access-xf2m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:06:46.957247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.957216    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf2m5\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-kube-api-access-xf2m5\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.957247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.957242    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.957247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.957254    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:46.957442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:46.957264    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20345eaf-ee37-4638-a965-dd76ec2ce108-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:06:47.200484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.200447    5073 generic.go:356] "Generic (PLEG): container finished" podID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerID="2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3" exitCode=0
Oct 30 07:06:47.200972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.200510    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"
Oct 30 07:06:47.200972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.200538    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" event={"ID":"20345eaf-ee37-4638-a965-dd76ec2ce108","Type":"ContainerDied","Data":"2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3"}
Oct 30 07:06:47.200972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.200609    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt" event={"ID":"20345eaf-ee37-4638-a965-dd76ec2ce108","Type":"ContainerDied","Data":"78ecfde44c7ae18ba48b7dc24c44b4d55488fc0d87456ceb2a910adc65285790"}
Oct 30 07:06:47.200972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.200646    5073 scope.go:122] "RemoveContainer" containerID="2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3"
Oct 30 07:06:47.211589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.211567    5073 scope.go:122] "RemoveContainer" containerID="4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"
Oct 30 07:06:47.220505 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.220479    5073 scope.go:122] "RemoveContainer" containerID="2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3"
Oct 30 07:06:47.220872 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:47.220820    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3\": container with ID starting with 2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3 not found: ID does not exist" containerID="2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3"
Oct 30 07:06:47.220954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.220924    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3"} err="failed to get container status \"2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3\": rpc error: code = NotFound desc = could not find container \"2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3\": container with ID starting with 2649c347632573b0a183017c10799e10803de4bcbf0d3173abbb7837e0f57fe3 not found: ID does not exist"
Oct 30 07:06:47.221003 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.220959    5073 scope.go:122] "RemoveContainer" containerID="4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"
Oct 30 07:06:47.221303 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:47.221284    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3\": container with ID starting with 4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3 not found: ID does not exist" containerID="4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"
Oct 30 07:06:47.221353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.221309    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3"} err="failed to get container status \"4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3\": rpc error: code = NotFound desc = could not find container \"4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3\": container with ID starting with 4aa25bf71c7e69a04fde5f18cb16dbb73e67aa31940bf2a7299fefc3076766c3 not found: ID does not exist"
Oct 30 07:06:47.343325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.343288    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"]
Oct 30 07:06:47.348970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.348939    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5b764790-openshift-default-9cfccd865-hzhtt"]
Oct 30 07:06:47.424671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:47.424630    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" path="/var/lib/kubelet/pods/20345eaf-ee37-4638-a965-dd76ec2ce108/volumes"
Oct 30 07:06:48.000093 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.000055    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"]
Oct 30 07:06:48.000942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.000919    5073 cpu_manager.go:414] "containerMap: removing container" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy"
Oct 30 07:06:48.000942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.000944    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy"
Oct 30 07:06:48.001085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.000965    5073 cpu_manager.go:414] "containerMap: removing container" podUID="aab757f1-7257-4c8b-9000-4d4d39d7e338" containerName="payload-pre-processing"
Oct 30 07:06:48.001085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.000974    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aab757f1-7257-4c8b-9000-4d4d39d7e338" containerName="payload-pre-processing"
Oct 30 07:06:48.001085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.000993    5073 cpu_manager.go:414] "containerMap: removing container" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy"
Oct 30 07:06:48.001085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.001000    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy"
Oct 30 07:06:48.001210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.001132    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy"
Oct 30 07:06:48.001210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.001145    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="aab757f1-7257-4c8b-9000-4d4d39d7e338" containerName="payload-pre-processing"
Oct 30 07:06:48.001210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.001153    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="20345eaf-ee37-4638-a965-dd76ec2ce108" containerName="istio-proxy"
Oct 30 07:06:48.005805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.005784    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.024079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.024055    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"]
Oct 30 07:06:48.038659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.038622    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-2bab4c-serving-cert\""
Oct 30 07:06:48.171701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.171668    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jppsn\" (UniqueName: \"kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.171876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.171724    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.171940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.171902    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.172067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.172047    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.273533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.273442    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.274014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.273537    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.274014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.273594    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jppsn\" (UniqueName: \"kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.274014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.273629    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.274430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.274403    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.276124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.276096    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.276398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.276368    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.303898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.303869    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jppsn\" (UniqueName: \"kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn\") pod \"maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.322355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.322329    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:48.704635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:48.702494    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"]
Oct 30 07:06:48.705394 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:06:48.705363    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc3a39e_055b_45ca_8c6f_02f8ca34532d.slice/crio-30756ca44f7d119841249eb7b433825a2dbcb5d56ebb774ccb53d74682aeec50 WatchSource:0}: Error finding container 30756ca44f7d119841249eb7b433825a2dbcb5d56ebb774ccb53d74682aeec50: Status 404 returned error can't find the container with id 30756ca44f7d119841249eb7b433825a2dbcb5d56ebb774ccb53d74682aeec50
Oct 30 07:06:49.214666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:49.214629    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6" event={"ID":"3fc3a39e-055b-45ca-8c6f-02f8ca34532d","Type":"ContainerStarted","Data":"b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60"}
Oct 30 07:06:49.214866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:49.214693    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6" event={"ID":"3fc3a39e-055b-45ca-8c6f-02f8ca34532d","Type":"ContainerStarted","Data":"30756ca44f7d119841249eb7b433825a2dbcb5d56ebb774ccb53d74682aeec50"}
Oct 30 07:06:49.214866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:49.214809    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:49.256484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:49.256433    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6" podStartSLOduration=1.8651829819999999 podStartE2EDuration="2.256417953s" totalImagesPullingTime="391.234971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:06:49.254881303 +0000 UTC m=+611.962761471" watchObservedRunningTime="2026-10-30 07:06:49.256417953 +0000 UTC m=+611.964298122"
Oct 30 07:06:52.206440 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:52.206409    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 07:06:53.169497 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:53.169463    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 07:06:53.169700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:53.169545    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 07:06:55.228510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:55.228475    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 07:06:58.270907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.270873    5073 generic.go:356] "Generic (PLEG): container finished" podID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerID="3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91" exitCode=0
Oct 30 07:06:58.271331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.270940    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" event={"ID":"aa733e26-9561-4b9c-a4eb-5ac0e927245b","Type":"ContainerDied","Data":"3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"}
Oct 30 07:06:58.271373 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.271330    5073 scope.go:122] "RemoveContainer" containerID="3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"
Oct 30 07:06:58.272714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.272689    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:58.272782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.272753    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:58.272889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.272785    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:06:58.802541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.802496    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"]
Oct 30 07:06:58.807470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.807442    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.823806 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.823774    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-06b26e-serving-cert\""
Oct 30 07:06:58.827600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.827571    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"]
Oct 30 07:06:58.844031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.843991    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.844207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.844059    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4ldt\" (UniqueName: \"kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.844207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.844151    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.844318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.844225    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.945384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.945346    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.945601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.945394    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4ldt\" (UniqueName: \"kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.945601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.945414    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.945601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.945452    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.945601 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:58.945570    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-serving-cert: secret "maas-api-e2e-worker-w0-06b26e-serving-cert" not found
Oct 30 07:06:58.945880 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:06:58.945644    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls podName:0a8643da-27a9-430f-a5c9-9fc8e6021c35 nodeName:}" failed. No retries permitted until 2026-10-30 07:06:59.445623244 +0000 UTC m=+622.153503406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls") pod "maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" (UID: "0a8643da-27a9-430f-a5c9-9fc8e6021c35") : secret "maas-api-e2e-worker-w0-06b26e-serving-cert" not found
Oct 30 07:06:58.946197 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.946179    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:58.947879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:58.947841    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:59.030696 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.030658    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4ldt\" (UniqueName: \"kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:59.297876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.286581    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" event={"ID":"aa733e26-9561-4b9c-a4eb-5ac0e927245b","Type":"ContainerStarted","Data":"2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012"}
Oct 30 07:06:59.451141 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.451096    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:59.454191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.454164    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\") pod \"maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:59.728486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.728451    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:06:59.865017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.864984    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:06:59.865198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.865039    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 07:06:59.865198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:06:59.865103    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 07:07:00.096875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:00.094110    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"]
Oct 30 07:07:00.131895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:00.124936    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:07:00.332044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:00.331789    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" event={"ID":"0a8643da-27a9-430f-a5c9-9fc8e6021c35","Type":"ContainerStarted","Data":"165bcdb32c726c713fc0385486324feaec3915414540d89cfd8c043eb051b913"}
Oct 30 07:07:00.862729 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:00.862706    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 07:07:00.862861 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:00.862742    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 07:07:01.343871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:01.343712    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" event={"ID":"0a8643da-27a9-430f-a5c9-9fc8e6021c35","Type":"ContainerStarted","Data":"cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040"}
Oct 30 07:07:01.344384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:01.344006    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:07:01.863025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:01.862982    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 07:07:01.863235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:01.863039    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 07:07:02.863173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:02.863117    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 07:07:02.863576 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:02.863192    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 07:07:03.863614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:03.863573    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 07:07:03.864183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:03.863635    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 07:07:04.867463 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:04.867431    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:07:04.867981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:04.867884    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:07:04.868602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:04.868583    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 07:07:04.932203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:04.932155    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" podStartSLOduration=6.357214076 podStartE2EDuration="6.932140625s" totalImagesPullingTime="574.926549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:07:01.393167924 +0000 UTC m=+624.101048170" watchObservedRunningTime="2026-10-30 07:07:04.932140625 +0000 UTC m=+627.640020843"
Oct 30 07:07:07.355659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:07.355629    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 07:07:09.401418 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:09.401332    5073 generic.go:356] "Generic (PLEG): container finished" podID="6db2a540-2696-4277-89f3-27012f35f846" containerID="0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9" exitCode=0
Oct 30 07:07:09.401953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:09.401406    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" event={"ID":"6db2a540-2696-4277-89f3-27012f35f846","Type":"ContainerDied","Data":"0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"}
Oct 30 07:07:09.402035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:09.401957    5073 scope.go:122] "RemoveContainer" containerID="0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"
Oct 30 07:07:09.403430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:09.403400    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:07:09.403564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:09.403486    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:07:09.403564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:09.403536    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:07:10.410343 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:10.410305    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" event={"ID":"6db2a540-2696-4277-89f3-27012f35f846","Type":"ContainerStarted","Data":"807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4"}
Oct 30 07:07:11.164794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:11.164749    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:07:11.165996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:11.165968    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 07:07:11.166149 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:11.166032    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 07:07:12.164509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:12.164474    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 07:07:12.164907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:12.164533    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 07:07:13.163653 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:13.163612    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 07:07:13.163879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:13.163666    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 07:07:13.924167 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:07:13.924130    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:07:14.163670 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:14.163639    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 07:07:14.163946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:14.163918    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 07:07:15.163963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:15.163926    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 07:07:15.164461 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:15.163983    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 07:07:15.196142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:15.196103    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:07:16.168521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:16.168492    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:07:16.169481 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:16.169461    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:07:29.748963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.748923    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"]
Oct 30 07:07:29.754395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.754367    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.776950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.776918    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"]
Oct 30 07:07:29.781462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.781357    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-06b26e\"/\"openshift-service-ca.crt\""
Oct 30 07:07:29.781462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.781385    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-06b26e\"/\"kube-root-ca.crt\""
Oct 30 07:07:29.781886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.781827    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.782031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.782011    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.782116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.782099    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.782177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.782154    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.782234 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.782177    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.782316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.782288    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9tgl\" (UniqueName: \"kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.784272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.784254    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-06b26e\"/\"default-dockercfg-spf2z\""
Oct 30 07:07:29.784409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.784367    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-06b26e\"/\"simulator-w0-06b26e-kserve-self-signed-certs\""
Oct 30 07:07:29.883274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883240    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883323    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883355    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883380    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883516    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9tgl\" (UniqueName: \"kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883598    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883713    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.883815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.883765    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.884026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.884003    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.886005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.885978    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.886177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.886159    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:29.909603 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:29.909570    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9tgl\" (UniqueName: \"kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl\") pod \"simulator-w0-06b26e-kserve-bcfd9d546-66jj2\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") " pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:30.068680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:30.068586    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:30.382743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:30.382711    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"]
Oct 30 07:07:30.383645 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:07:30.383619    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf80e61c5_c6b3_4471_81b4_4ede125e1b13.slice/crio-c554f56bb8dab1995dce590de9485955d1e5016fa058ce8e664dad0d4b45b2e4 WatchSource:0}: Error finding container c554f56bb8dab1995dce590de9485955d1e5016fa058ce8e664dad0d4b45b2e4: Status 404 returned error can't find the container with id c554f56bb8dab1995dce590de9485955d1e5016fa058ce8e664dad0d4b45b2e4
Oct 30 07:07:30.552783 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:30.552739    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" event={"ID":"f80e61c5-c6b3-4471-81b4-4ede125e1b13","Type":"ContainerStarted","Data":"ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59"}
Oct 30 07:07:30.552989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:30.552794    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" event={"ID":"f80e61c5-c6b3-4471-81b4-4ede125e1b13","Type":"ContainerStarted","Data":"c554f56bb8dab1995dce590de9485955d1e5016fa058ce8e664dad0d4b45b2e4"}
Oct 30 07:07:30.592942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:30.592893    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podStartSLOduration=1.592880232 podStartE2EDuration="1.592880232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:07:30.592044355 +0000 UTC m=+653.299924525" watchObservedRunningTime="2026-10-30 07:07:30.592880232 +0000 UTC m=+653.300760402"
Oct 30 07:07:31.069347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:31.069307    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:40.069452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:40.069415    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:40.088084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:40.088050    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:40.630460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:40.630421    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:07:43.922216 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:07:43.922180    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:07:57.554801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.554718    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"]
Oct 30 07:07:57.559034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.559014    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.573114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.573088    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-2eda2c-openshift-default-dockercfg-bdk2w\""
Oct 30 07:07:57.589534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.589504    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"]
Oct 30 07:07:57.695950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.695916    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.695950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.695954    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.695980    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.696001    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.696084    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.696142    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.696177    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8b7\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.696199    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.696544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.696278    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797289 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797250    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797309    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797345    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797372    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797400    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797441    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797490    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8b7\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797523    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797598    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797670    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.797838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.797703    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.798091 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.798068    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.798233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.798212    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.798308 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.798290    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.799892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.799838    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.800600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.800578    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.820519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.820460    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.820519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.820482    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8b7\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:57.872415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:57.872387    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:58.199928 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:07:58.199899    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa7bd5e_abe0_4359_9b61_8046932572b7.slice/crio-4746fac09038dad7c6c54246264e5ff3fa513eb2d5e61183a90773ecaf9185de WatchSource:0}: Error finding container 4746fac09038dad7c6c54246264e5ff3fa513eb2d5e61183a90773ecaf9185de: Status 404 returned error can't find the container with id 4746fac09038dad7c6c54246264e5ff3fa513eb2d5e61183a90773ecaf9185de
Oct 30 07:07:58.200520 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.200492    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"]
Oct 30 07:07:58.202239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.202206    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:07:58.202332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.202269    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:07:58.202332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.202297    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:07:58.737454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.737415    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" event={"ID":"ffa7bd5e-abe0-4359-9b61-8046932572b7","Type":"ContainerStarted","Data":"df85132a4a54856c2e7b232e8a2c4c54ce2c20cf7d330a2a8247205dca6dddbd"}
Oct 30 07:07:58.737870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.737473    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" event={"ID":"ffa7bd5e-abe0-4359-9b61-8046932572b7","Type":"ContainerStarted","Data":"4746fac09038dad7c6c54246264e5ff3fa513eb2d5e61183a90773ecaf9185de"}
Oct 30 07:07:58.809784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.809710    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podStartSLOduration=1.809692111 podStartE2EDuration="1.809692111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:07:58.796403096 +0000 UTC m=+681.504283253" watchObservedRunningTime="2026-10-30 07:07:58.809692111 +0000 UTC m=+681.517572281"
Oct 30 07:07:58.885355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:58.884943    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:07:59.876793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:59.876753    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 07:07:59.877504 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:07:59.877467    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 07:08:00.884885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:00.884188    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 07:08:00.884885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:00.884253    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 07:08:01.875888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:01.875369    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 07:08:01.875888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:01.875429    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 07:08:02.890877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:02.875241    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 07:08:02.890877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:02.875306    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 07:08:03.884877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:03.881246    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 07:08:03.884877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:03.881310    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 07:08:04.891613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:04.888148    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:08:04.891613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:04.889354    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:08:04.891613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:04.890156    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:08:13.923808 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:08:13.923767    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:08:23.765618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.765578    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"]
Oct 30 07:08:23.773381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.773357    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.787562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.787540    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-2bab4c-openshift-default-dockercfg-gqrfc\""
Oct 30 07:08:23.802016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.801990    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"]
Oct 30 07:08:23.930299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930272    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bdgn\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930310    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930331    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930432    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930503    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930557    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930580    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930599    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:23.930712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:23.930615    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.031840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031774    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.031840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031817    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031842    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031894    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031917    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031971    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bdgn\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.031998    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032018    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032063    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032214    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032244    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032297    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032632 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032493    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.032799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.032780    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.034416 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.034382    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.034592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.034572    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.055215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.055190    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.055511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.055491    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bdgn\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.087187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.087168    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:24.405900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.405868    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"]
Oct 30 07:08:24.406128 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:08:24.406105    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd253fe1b_14fc_409c_87c5_1d44d14a2281.slice/crio-30d5dcfb8be3d46877359934230e4a360f778dd1e9638f2cf2245100465fefa9 WatchSource:0}: Error finding container 30d5dcfb8be3d46877359934230e4a360f778dd1e9638f2cf2245100465fefa9: Status 404 returned error can't find the container with id 30d5dcfb8be3d46877359934230e4a360f778dd1e9638f2cf2245100465fefa9
Oct 30 07:08:24.408620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.408554    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:08:24.408620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.408619    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:08:24.408765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.408647    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:08:24.949906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.949872    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" event={"ID":"d253fe1b-14fc-409c-87c5-1d44d14a2281","Type":"ContainerStarted","Data":"d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631"}
Oct 30 07:08:24.950283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:24.949930    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" event={"ID":"d253fe1b-14fc-409c-87c5-1d44d14a2281","Type":"ContainerStarted","Data":"30d5dcfb8be3d46877359934230e4a360f778dd1e9638f2cf2245100465fefa9"}
Oct 30 07:08:25.021587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:25.021030    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podStartSLOduration=2.02101025 podStartE2EDuration="2.02101025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:08:25.014657421 +0000 UTC m=+707.722537629" watchObservedRunningTime="2026-10-30 07:08:25.02101025 +0000 UTC m=+707.728890420"
Oct 30 07:08:25.096889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:25.096295    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:25.098944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:25.098911    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 07:08:25.099122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:25.098964    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 07:08:26.091875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:26.091271    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 07:08:26.091875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:26.091331    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 07:08:27.092875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:27.088944    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 07:08:27.092875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:27.089017    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 07:08:28.090876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:28.089395    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 07:08:28.090876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:28.089454    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 07:08:29.099876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:29.091253    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 07:08:29.099876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:29.091320    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 07:08:30.090508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:30.090462    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 07:08:30.090963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:30.090925    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 07:08:31.092175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:31.092144    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:31.092661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:31.092647    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:31.093519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:31.093496    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:08:43.935799 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:08:43.935756    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:08:57.815796 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.815763    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"]
Oct 30 07:08:57.820725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.820699    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.856181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.856146    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"]
Oct 30 07:08:57.973277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973235    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973293    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973385    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973435    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973481    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973627    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973689    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bpn9\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973738    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:57.973877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:57.973846    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074519    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074594    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074633    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074678    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074730    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074792    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.074891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.074824    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075020    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075121    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075126    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bpn9\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075329 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075194    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075329 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075211    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075369    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.075763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.075743    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.077135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.077113    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.077260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.077244    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.097546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.097519    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.097839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.097818    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bpn9\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.137507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.137478    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:08:58.459912 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.459885    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"]
Oct 30 07:08:58.460282 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:08:58.460262    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c55e8e_e138_4db7_8bda_27b4f0eb620b.slice/crio-f3d807f2d22c8c6c04b0fb45931c19b2720f2463e2778b06e7e45a2fe23f8917 WatchSource:0}: Error finding container f3d807f2d22c8c6c04b0fb45931c19b2720f2463e2778b06e7e45a2fe23f8917: Status 404 returned error can't find the container with id f3d807f2d22c8c6c04b0fb45931c19b2720f2463e2778b06e7e45a2fe23f8917
Oct 30 07:08:58.462543 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.462511    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:08:58.462622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.462576    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:08:58.462622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:58.462605    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:08:59.207398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:59.207360    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" event={"ID":"76c55e8e-e138-4db7-8bda-27b4f0eb620b","Type":"ContainerStarted","Data":"1ac807844825aacb6e8ac790b3a9769c9ad78c878bec89daf44d4e90830159d5"}
Oct 30 07:08:59.207825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:59.207421    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" event={"ID":"76c55e8e-e138-4db7-8bda-27b4f0eb620b","Type":"ContainerStarted","Data":"f3d807f2d22c8c6c04b0fb45931c19b2720f2463e2778b06e7e45a2fe23f8917"}
Oct 30 07:08:59.296877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:08:59.296658    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podStartSLOduration=2.296638478 podStartE2EDuration="2.296638478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:08:59.275623238 +0000 UTC m=+741.983503411" watchObservedRunningTime="2026-10-30 07:08:59.296638478 +0000 UTC m=+742.004518647"
Oct 30 07:09:00.137833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:00.137799    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:09:00.139413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:00.139385    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 07:09:00.139528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:00.139434    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 07:09:01.138665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:01.138629    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 07:09:01.139081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:01.138685    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 07:09:02.138828 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:02.138791    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 07:09:02.139270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:02.138878    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 07:09:03.138420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:03.138387    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 07:09:03.138591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:03.138453    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 07:09:04.139794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:04.139354    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 07:09:04.139794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:04.139414    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 07:09:05.847871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:05.847806    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:09:05.848475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:05.848452    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:09:05.849450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:05.849426    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:09:13.922929 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:09:13.922890    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:09:20.596946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.596842    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"]
Oct 30 07:09:20.602064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.602040    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.621432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.621403    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"]
Oct 30 07:09:20.629668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.629641    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4fe2ed\"/\"openshift-service-ca.crt\""
Oct 30 07:09:20.629841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.629647    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4fe2ed\"/\"kube-root-ca.crt\""
Oct 30 07:09:20.629841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.629742    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4fe2ed\"/\"distinct-w1-4fe2ed-kserve-self-signed-certs\""
Oct 30 07:09:20.629841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.629769    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4fe2ed\"/\"default-dockercfg-7chhx\""
Oct 30 07:09:20.677036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.677002    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.677169 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.677121    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2vw\" (UniqueName: \"kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.677221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.677183    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.677265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.677245    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.677305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.677272    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.677305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.677298    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.778724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.778677    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.778724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.778740    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779018 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.778775    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779018 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.778927    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.779047    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2vw\" (UniqueName: \"kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.779188    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.779277    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.779496    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.779599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.779565    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.781016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.780996    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.781203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.781186    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.814666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.814620    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2vw\" (UniqueName: \"kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw\") pod \"distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") " pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:20.916895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:20.916863    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:21.241303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:21.241267    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"]
Oct 30 07:09:21.242980 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:09:21.242946    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf691d503_b3ce_4587_83b9_99bf39214197.slice/crio-8240d9c06bbab98ab50ea1b97afb0c14821956a9fb711add721f5d1fde7533d1 WatchSource:0}: Error finding container 8240d9c06bbab98ab50ea1b97afb0c14821956a9fb711add721f5d1fde7533d1: Status 404 returned error can't find the container with id 8240d9c06bbab98ab50ea1b97afb0c14821956a9fb711add721f5d1fde7533d1
Oct 30 07:09:21.387506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:21.387456    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" event={"ID":"f691d503-b3ce-4587-83b9-99bf39214197","Type":"ContainerStarted","Data":"35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc"}
Oct 30 07:09:21.387703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:21.387605    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" event={"ID":"f691d503-b3ce-4587-83b9-99bf39214197","Type":"ContainerStarted","Data":"8240d9c06bbab98ab50ea1b97afb0c14821956a9fb711add721f5d1fde7533d1"}
Oct 30 07:09:21.428183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:21.428117    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podStartSLOduration=1.428098076 podStartE2EDuration="1.428098076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:09:21.427689742 +0000 UTC m=+764.135569940" watchObservedRunningTime="2026-10-30 07:09:21.428098076 +0000 UTC m=+764.135978246"
Oct 30 07:09:21.917862 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:21.917828    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:30.920876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:30.920003    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:30.959201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:30.959166    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:31.472463 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:31.472431    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:09:43.936076 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:09:43.936034    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:09:50.061267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.061184    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"]
Oct 30 07:09:50.067458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.067433    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.101275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.101239    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-bb6be4\"/\"kube-root-ca.crt\""
Oct 30 07:09:50.101432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.101351    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-bb6be4\"/\"openshift-service-ca.crt\""
Oct 30 07:09:50.101432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.101362    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bb6be4\"/\"distinct-w2-bb6be4-kserve-self-signed-certs\""
Oct 30 07:09:50.103034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.103014    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bb6be4\"/\"default-dockercfg-77htj\""
Oct 30 07:09:50.105765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.105733    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"]
Oct 30 07:09:50.158152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.158113    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.158303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.158168    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.158364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.158319    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4dbb\" (UniqueName: \"kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.158487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.158462    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.158548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.158498    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.158599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.158547    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.264561    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.264622    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.264685    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4dbb\" (UniqueName: \"kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.264792    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.264815    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.264872    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.265680    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.265930    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.267877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.266168    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.300604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.300207    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.304632 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.304599    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4dbb\" (UniqueName: \"kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.305702 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.305672    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm\") pod \"distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") " pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.382961 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.382931    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:09:50.686330 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:50.686304    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"]
Oct 30 07:09:50.686925 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:09:50.686895    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d98e771_de3f_40d3_83be_e3ed54995a3d.slice/crio-b0f6f6ec7c542a876e3aaf0d783301cedbfec85e760527d38e9bfa96524f7f0e WatchSource:0}: Error finding container b0f6f6ec7c542a876e3aaf0d783301cedbfec85e760527d38e9bfa96524f7f0e: Status 404 returned error can't find the container with id b0f6f6ec7c542a876e3aaf0d783301cedbfec85e760527d38e9bfa96524f7f0e
Oct 30 07:09:51.611625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:51.611590    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" event={"ID":"2d98e771-de3f-40d3-83be-e3ed54995a3d","Type":"ContainerStarted","Data":"e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865"}
Oct 30 07:09:51.612131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:51.611645    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" event={"ID":"2d98e771-de3f-40d3-83be-e3ed54995a3d","Type":"ContainerStarted","Data":"b0f6f6ec7c542a876e3aaf0d783301cedbfec85e760527d38e9bfa96524f7f0e"}
Oct 30 07:09:51.654511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:51.654462    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podStartSLOduration=1.654449893 podStartE2EDuration="1.654449893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:09:51.651546647 +0000 UTC m=+794.359426807" watchObservedRunningTime="2026-10-30 07:09:51.654449893 +0000 UTC m=+794.362330115"
Oct 30 07:09:52.383394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:09:52.383353    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:10:00.383953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:00.383919    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:10:00.396752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:00.396719    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:10:00.688612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:00.688533    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:10:06.616830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.616788    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"]
Oct 30 07:10:06.621361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.621338    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.647694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.647667    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2bab4c\"/\"openshift-service-ca.crt\""
Oct 30 07:10:06.648160 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.648136    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2bab4c\"/\"default-dockercfg-tccm9\""
Oct 30 07:10:06.650789 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.650767    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2bab4c\"/\"distinct-2-w4-2bab4c-kserve-self-signed-certs\""
Oct 30 07:10:06.650942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.650807    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2bab4c\"/\"kube-root-ca.crt\""
Oct 30 07:10:06.651025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.650979    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"]
Oct 30 07:10:06.669777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.669748    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.669925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.669808    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.669925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.669894    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.670050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.669939    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52p4g\" (UniqueName: \"kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.670112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.670093    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.670173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.670147    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771253    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771323    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771370    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771433    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52p4g\" (UniqueName: \"kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771517    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771559    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.771872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771821    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.772015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771908    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.772015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.771983    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.774285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.774262    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.774594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.774572    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.794786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.794757    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52p4g\" (UniqueName: \"kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g\") pod \"distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") " pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:06.937559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:06.937522    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:07.254564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:07.254533    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"]
Oct 30 07:10:07.255036 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:10:07.255007    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc8b0807_15b2_4029_919d_7c265542f8d8.slice/crio-fdc123b90bf9eaa0ea7f7660a848709cf8758a2e8ceba80199e224307f262389 WatchSource:0}: Error finding container fdc123b90bf9eaa0ea7f7660a848709cf8758a2e8ceba80199e224307f262389: Status 404 returned error can't find the container with id fdc123b90bf9eaa0ea7f7660a848709cf8758a2e8ceba80199e224307f262389
Oct 30 07:10:07.723833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:07.723794    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" event={"ID":"dc8b0807-15b2-4029-919d-7c265542f8d8","Type":"ContainerStarted","Data":"af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e"}
Oct 30 07:10:07.724282 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:07.723841    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" event={"ID":"dc8b0807-15b2-4029-919d-7c265542f8d8","Type":"ContainerStarted","Data":"fdc123b90bf9eaa0ea7f7660a848709cf8758a2e8ceba80199e224307f262389"}
Oct 30 07:10:07.764008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:07.763951    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podStartSLOduration=1.763937602 podStartE2EDuration="1.763937602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:10:07.763369699 +0000 UTC m=+810.471249879" watchObservedRunningTime="2026-10-30 07:10:07.763937602 +0000 UTC m=+810.471817771"
Oct 30 07:10:07.938262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:07.938222    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:13.025966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.025927    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"]
Oct 30 07:10:13.030200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.030179    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.060470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.060436    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"]
Oct 30 07:10:13.161758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.161724    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.161949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.161777    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.161949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.161883    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wqf\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.162037 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.161944    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.162071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.162036    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.162108 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.162082    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.162155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.162141    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.162249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.162237    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.162284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.162261    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.263830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.263793    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.263830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.263836    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.263899    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.263932    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.263964    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wqf\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264012    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264050    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264094    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264136    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264266    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264292    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264444    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264598 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264569    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.264718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.264685    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.266301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.266281    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.266531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.266513    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.286396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.286340    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.286525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.286397    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wqf\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.345489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.345461    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:13.670886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.670823    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"]
Oct 30 07:10:13.671077 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:10:13.671053    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1c830b_dcbc_40fe_a682_74ed9edb8cd6.slice/crio-7fae0e5c587d6bb8c3998dce270dd02ad94c7672fe7f22d93f4cd2498a2ceec5 WatchSource:0}: Error finding container 7fae0e5c587d6bb8c3998dce270dd02ad94c7672fe7f22d93f4cd2498a2ceec5: Status 404 returned error can't find the container with id 7fae0e5c587d6bb8c3998dce270dd02ad94c7672fe7f22d93f4cd2498a2ceec5
Oct 30 07:10:13.673528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.673498    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:13.673600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.673564    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:13.673600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.673592    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:13.773783 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.773747    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" event={"ID":"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6","Type":"ContainerStarted","Data":"e8b5d76cd358af2be12bf7bf27f2245ba9abb7984cea274e12efc3297ea0a546"}
Oct 30 07:10:13.773940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.773818    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" event={"ID":"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6","Type":"ContainerStarted","Data":"7fae0e5c587d6bb8c3998dce270dd02ad94c7672fe7f22d93f4cd2498a2ceec5"}
Oct 30 07:10:13.823526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:13.823459    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podStartSLOduration=1.823440174 podStartE2EDuration="1.823440174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:10:13.819994036 +0000 UTC m=+816.527874206" watchObservedRunningTime="2026-10-30 07:10:13.823440174 +0000 UTC m=+816.531320344"
Oct 30 07:10:13.931364 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:10:13.931270    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:10:14.346516 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:14.346424    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:14.348229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:14.348206    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:14.348292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:14.348255    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:15.346411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:15.346371    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:15.346594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:15.346430    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:16.346069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:16.346034    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:16.346286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:16.346096    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:16.938531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:16.938493    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:16.951320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:16.951294    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:17.346710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:17.346618    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:17.346710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:17.346686    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:17.837448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:17.837412    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:10:18.357873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:18.347162    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:18.357873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:18.347229    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:19.346841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:19.346797    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:19.347069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:19.346883    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:20.346742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:20.346701    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 07:10:20.347268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:20.346771    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 07:10:22.317904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:22.317822    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:22.318599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:22.318571    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:22.319618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:22.319597    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:10:39.207511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.207468    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"]
Oct 30 07:10:39.211614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.211588    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.241324 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.241296    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"]
Oct 30 07:10:39.336815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.336774    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.336815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.336816    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.336927    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.337032    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.337101    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.337137    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.337169    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.337326    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.337438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.337423    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p45tz\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438149    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438218    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p45tz\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438252    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438269    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438310    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438328    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438370    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438393    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438424    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438542    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438653    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438775    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.438964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.438932    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.439164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.439144    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.440944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.440923    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.441071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.441052    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.461047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.460984    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.461135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.461083    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p45tz\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.527391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.527367    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:39.853619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.853591    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"]
Oct 30 07:10:39.854005 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:10:39.853981    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0a1d28_c6e4_4356_934f_a66b0606708e.slice/crio-5ade2d7b7a44f50f5f0c1a9fc4a27469e627c0f98bdfb4c6e311ad15b28220f9 WatchSource:0}: Error finding container 5ade2d7b7a44f50f5f0c1a9fc4a27469e627c0f98bdfb4c6e311ad15b28220f9: Status 404 returned error can't find the container with id 5ade2d7b7a44f50f5f0c1a9fc4a27469e627c0f98bdfb4c6e311ad15b28220f9
Oct 30 07:10:39.856431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.856400    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:39.856530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.856476    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:39.856530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.856519    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:39.978569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.978531    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" event={"ID":"9d0a1d28-c6e4-4356-934f-a66b0606708e","Type":"ContainerStarted","Data":"c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b"}
Oct 30 07:10:39.978786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:39.978593    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" event={"ID":"9d0a1d28-c6e4-4356-934f-a66b0606708e","Type":"ContainerStarted","Data":"5ade2d7b7a44f50f5f0c1a9fc4a27469e627c0f98bdfb4c6e311ad15b28220f9"}
Oct 30 07:10:40.022412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:40.022354    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podStartSLOduration=1.022340898 podStartE2EDuration="1.022340898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:10:40.02147783 +0000 UTC m=+842.729358000" watchObservedRunningTime="2026-10-30 07:10:40.022340898 +0000 UTC m=+842.730221068"
Oct 30 07:10:40.528188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:40.528141    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:40.530059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:40.530030    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:40.530206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:40.530082    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:41.528637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:41.528595    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:41.529102 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:41.528656    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:42.527994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:42.527954    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:42.528182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:42.528008    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:43.528683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:43.528650    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:43.529094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:43.528711    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:43.929373 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:10:43.929335    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:10:44.528724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:44.528676    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:44.529252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:44.528743    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:45.530263 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:45.530221    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:45.530755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:45.530285    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:46.527785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:46.527739    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 07:10:46.528036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:46.527813    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 07:10:47.532055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:47.531970    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:47.532601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:47.532494    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:47.533356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:47.533335    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:10:54.267371 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.267338    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"]
Oct 30 07:10:54.271637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.271615    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.300183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.300150    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"]
Oct 30 07:10:54.353120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353066    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353125    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353288    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353390    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353419    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353549 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353536    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353560    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvp6p\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353577    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.353710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.353690    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.454790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.454751    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.454790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.454796    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.454877    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.454931    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.454948    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455028    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455060    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvp6p\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455085    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455132    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455323    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455505    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455570    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455696 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455670    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.455910 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.455884    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.457338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.457314    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.457571 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.457553    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.480358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.480334    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.480476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.480459    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvp6p\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.587435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.587364    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:54.960646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.960605    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"]
Oct 30 07:10:54.962437 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:10:54.962408    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849ad3e0_1adf_4b9f_a141_46bebaafc5dc.slice/crio-ca6058b24c965df604ee70cba2fce69ddbde7d0d27db1e612485198adafa0449 WatchSource:0}: Error finding container ca6058b24c965df604ee70cba2fce69ddbde7d0d27db1e612485198adafa0449: Status 404 returned error can't find the container with id ca6058b24c965df604ee70cba2fce69ddbde7d0d27db1e612485198adafa0449
Oct 30 07:10:54.965014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.964984    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:54.965082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.965050    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:54.965116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:54.965080    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:55.114876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:55.113844    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" event={"ID":"849ad3e0-1adf-4b9f-a141-46bebaafc5dc","Type":"ContainerStarted","Data":"a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045"}
Oct 30 07:10:55.114876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:55.113924    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" event={"ID":"849ad3e0-1adf-4b9f-a141-46bebaafc5dc","Type":"ContainerStarted","Data":"ca6058b24c965df604ee70cba2fce69ddbde7d0d27db1e612485198adafa0449"}
Oct 30 07:10:55.169834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:55.169770    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podStartSLOduration=1.1697524 podStartE2EDuration="1.1697524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:10:55.166381202 +0000 UTC m=+857.874261409" watchObservedRunningTime="2026-10-30 07:10:55.1697524 +0000 UTC m=+857.877632570"
Oct 30 07:10:55.590017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:55.589980    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:10:56.602877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:56.597939    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 07:10:56.602877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:56.598011    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 07:10:57.598327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:57.598286    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 07:10:57.598604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:57.598574    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 07:10:58.590872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.590314    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 07:10:58.590872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.590390    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 07:10:58.704988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.704949    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"]
Oct 30 07:10:58.710127 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.710099    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.728085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.728059    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"]
Oct 30 07:10:58.828611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.828568    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.828826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.828637    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.828826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.828773    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.828964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.828837    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.829022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.828970    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.829075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.829033    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.829134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.829086    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skh6v\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.829190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.829136    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.829244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.829217    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930368    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930418    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930459    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930487    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930538    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930595    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930620    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skh6v\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930666    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.930752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.930701    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.931029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.931005    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.931089 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.931062    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.931150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.931126    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.931426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.931401    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.931520 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.931432    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.933039 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.933018    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.933241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.933225    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.955215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.955194    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:58.956629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:58.956606    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skh6v\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:59.028898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.028838    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:10:59.405298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.405261    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"]
Oct 30 07:10:59.405820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.405769    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:59.405950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.405885    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:59.405950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.405932    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:10:59.591884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.589209    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 07:10:59.591884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:10:59.589268    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 07:11:00.150737 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:00.150694    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" event={"ID":"96809b63-5022-485a-a1cf-24f47bd96f44","Type":"ContainerStarted","Data":"8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c"}
Oct 30 07:11:00.150928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:00.150746    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" event={"ID":"96809b63-5022-485a-a1cf-24f47bd96f44","Type":"ContainerStarted","Data":"21d9d266665df891da795e51e638dee6d70a92fd293c32bb838b5967961e301d"}
Oct 30 07:11:00.593933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:00.593267    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 07:11:00.593933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:00.593332    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 07:11:01.029878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:01.029551    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:11:01.031445 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:01.031418    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:01.031566 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:01.031468    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:01.590293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:01.590251    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 07:11:01.590561 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:01.590530    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 07:11:02.029674 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:02.029638    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:02.030255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:02.029690    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:02.607386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:02.607343    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:11:02.608108 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:02.608085    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:11:02.609178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:02.609149    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:11:02.681905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:02.681817    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podStartSLOduration=4.681795646 podStartE2EDuration="4.681795646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:11:00.208035733 +0000 UTC m=+862.915915919" watchObservedRunningTime="2026-10-30 07:11:02.681795646 +0000 UTC m=+865.389675832"
Oct 30 07:11:03.039438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:03.039395    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:03.039975 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:03.039474    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:04.060103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:04.060062    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:04.060702 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:04.060670    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:04.464451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:04.463356    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:04.690522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:04.690474    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:04.828452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:04.827348    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:11:05.033524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:05.033482    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:05.043948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:05.043904    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:05.710489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:05.710445    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:11:05.818879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:05.789302    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:11:05.938875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:05.911089    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:11:05.979933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:05.964316    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:11:06.254945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.052919    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:06.254945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.251867    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:06.254945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.098979    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:11:06.254945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.251941    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:06.254945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.147939    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:11:06.254945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.252338    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:06.467582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.467533    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:06.680874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.680723    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:06.811876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.803970    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:06.947050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:06.946944    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:07.050005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:07.049967    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:07.062110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:07.061962    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:07.513779 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:07.513726    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:11:07.519586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:07.519556    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:11:08.029676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:08.029638    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 07:11:08.030186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:08.029705    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 07:11:09.330442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:09.330404    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:11:09.330930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:09.330862    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:11:09.331724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:09.331702    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 07:11:13.922583 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:11:13.922548    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:11:24.624063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:24.624012    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:11:24.799877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:24.737234    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"]
Oct 30 07:11:24.975930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:24.951619    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:24.975930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:24.956942    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:11:25.026876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:24.979443    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"]
Oct 30 07:11:25.027506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.019591    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.027733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.027711    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.027927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.027907    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.028067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.028047    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.028209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.028193    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.028346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.028328    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j74vj\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.028583 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.028562    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.028703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.028687    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.028911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.028893    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.135801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.135763    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.136533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.136509    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.155993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.136450    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.156211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.137361    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.156388 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.156356    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.156981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.156946    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j74vj\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.157510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.157489    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.189782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.189255    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.190161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.157989    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.191904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.190486    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.191904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.191110    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.191904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.191212    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.191904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.191583    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.191904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.191833    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.211901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.211818    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.216161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.216134    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.219869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.219826    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j74vj\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.275930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.265218    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.378221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.378173    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:25.449993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.449947    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:11:25.472637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.472587    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:25.959776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:25.959740    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"]
Oct 30 07:11:26.016750 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.006179    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:26.016750 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.006358    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:26.016750 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.006450    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:26.223867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.223202    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" event={"ID":"fee496f0-8439-4d38-8b30-59be3c7fbd34","Type":"ContainerStarted","Data":"9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832"}
Oct 30 07:11:26.223867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.223286    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" event={"ID":"fee496f0-8439-4d38-8b30-59be3c7fbd34","Type":"ContainerStarted","Data":"acfa7b3b6c764b6f706a9585bc1d56a0bde90ac7de03a0dd30dfb7a4e5d94c74"}
Oct 30 07:11:26.270925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.270716    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podStartSLOduration=2.270695835 podStartE2EDuration="2.270695835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:11:26.267427009 +0000 UTC m=+888.975307208" watchObservedRunningTime="2026-10-30 07:11:26.270695835 +0000 UTC m=+888.978576005"
Oct 30 07:11:26.379279 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:26.379240    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:27.395989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:27.391970    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:27.395989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:27.392034    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:28.386650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.386202    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:28.386650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.386263    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:28.807252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.807170    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"]
Oct 30 07:11:28.812431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.812404    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.827753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.827706    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.827960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.827769    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.827960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.827830    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.827960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.827904    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.827960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.827955    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.828270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.828113    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.828270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.828145    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p545t\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.828270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.828192    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.828270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.828213    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.841243 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.841218    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"]
Oct 30 07:11:28.928943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.928909    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.928955    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929054    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929074    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p545t\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929094    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929110    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929168    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929186    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929229    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929474    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929479    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929559    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.929660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929630    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.930005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.929983    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.931545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.931521    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.932461 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.932437    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.951577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.951550    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:28.951673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:28.951610    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p545t\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:29.012082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.012045    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"]
Oct 30 07:11:29.018636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.018611    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.026870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.026820    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"]
Oct 30 07:11:29.031158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031131    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwth\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031184    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031233    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031324 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031286    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031323    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031421 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031400    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031434    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031470    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.031635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.031618    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.033178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.033151    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-06b26e-openshift-default-dockercfg-t2k6l\""
Oct 30 07:11:29.137904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.137723    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.137904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.137786    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.137904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.137897    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.137920    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.137947    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:29.138336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138250    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138272    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138341    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138488    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwth\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138560    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138663 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138648    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.138906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.138887    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.139710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.139663    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.139838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.139749    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.139943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.139823    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.142067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.142048    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.142163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.142051    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.163154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.163127    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwth\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.163619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.163597    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.338425 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.338389    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:29.412927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.409990    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:29.412927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.410053    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:29.512984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.512835    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"]
Oct 30 07:11:29.514162 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:11:29.514134    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edbd30a_3295_4e9e_bfaa_6587a6e732ac.slice/crio-9874663a325537da27b250098df8ede1f681a9d1117b04de2f7ca651dc2b20c1 WatchSource:0}: Error finding container 9874663a325537da27b250098df8ede1f681a9d1117b04de2f7ca651dc2b20c1: Status 404 returned error can't find the container with id 9874663a325537da27b250098df8ede1f681a9d1117b04de2f7ca651dc2b20c1
Oct 30 07:11:29.517658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.517060    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:29.517658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.517123    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:29.517658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.517150    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:29.710501 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.710463    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"]
Oct 30 07:11:29.716058 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:11:29.716000    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedb5615_f04f_4645_beea_400df984421d.slice/crio-06d098136e7db36db42b2e70b77fa14a54c876846d8150e6e0da4b2754eb300a WatchSource:0}: Error finding container 06d098136e7db36db42b2e70b77fa14a54c876846d8150e6e0da4b2754eb300a: Status 404 returned error can't find the container with id 06d098136e7db36db42b2e70b77fa14a54c876846d8150e6e0da4b2754eb300a
Oct 30 07:11:29.720061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.720018    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:29.720151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.720131    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:29.720215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:29.720197    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:30.269876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.266224    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" event={"ID":"dedb5615-f04f-4645-beea-400df984421d","Type":"ContainerStarted","Data":"f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4"}
Oct 30 07:11:30.269876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.266296    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" event={"ID":"dedb5615-f04f-4645-beea-400df984421d","Type":"ContainerStarted","Data":"06d098136e7db36db42b2e70b77fa14a54c876846d8150e6e0da4b2754eb300a"}
Oct 30 07:11:30.269876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.269189    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" event={"ID":"8edbd30a-3295-4e9e-bfaa-6587a6e732ac","Type":"ContainerStarted","Data":"186e5a78eda65b1d467c5a195496252257156fcc04cf3c3dc31019ee517b2bc9"}
Oct 30 07:11:30.269876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.269247    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" event={"ID":"8edbd30a-3295-4e9e-bfaa-6587a6e732ac","Type":"ContainerStarted","Data":"9874663a325537da27b250098df8ede1f681a9d1117b04de2f7ca651dc2b20c1"}
Oct 30 07:11:30.344876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.342722    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:30.344876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.342867    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:30.344876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.342909    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:30.398879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.398480    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:30.398879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.398544    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:30.410906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.402555    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podStartSLOduration=2.402533903 podStartE2EDuration="2.402533903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:11:30.399127602 +0000 UTC m=+893.107007773" watchObservedRunningTime="2026-10-30 07:11:30.402533903 +0000 UTC m=+893.110414073"
Oct 30 07:11:30.410906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:30.403150    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podStartSLOduration=2.403140361 podStartE2EDuration="2.403140361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:11:30.340400793 +0000 UTC m=+893.048280980" watchObservedRunningTime="2026-10-30 07:11:30.403140361 +0000 UTC m=+893.111020533"
Oct 30 07:11:31.156876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.148961    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:31.156876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.151685    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 07:11:31.156876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.151746    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 07:11:31.341697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.341261    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:31.341697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.341323    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:31.393476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.393031    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:31.393476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:31.393092    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:32.143918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:32.142242    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 07:11:32.143918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:32.142312    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 07:11:32.349875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:32.349474    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:32.349875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:32.349539    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:32.388358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:32.388323    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:32.388661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:32.388635    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:33.146372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:33.139613    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 07:11:33.148981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:33.148939    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 07:11:33.339278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:33.339240    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:33.339547 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:33.339518    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:33.385885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:33.385332    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 07:11:33.385885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:33.385410    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 07:11:34.140083 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.140042    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 07:11:34.140312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.140106    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 07:11:34.341831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.341792    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:34.342137 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.342093    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:34.403929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.403209    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:34.414876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.409888    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:34.440956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:34.440899    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 07:11:35.138691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.138644    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 07:11:35.139207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.139156    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 07:11:35.339435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.339399    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:35.339700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.339672    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:35.598927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.597827    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"]
Oct 30 07:11:35.632921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.632194    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.637929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.637448    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"]
Oct 30 07:11:35.732947 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.732905    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.733222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.733202    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.733398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.733382    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.733656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.733639    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.733789 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.733772    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.733941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.733922    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lc9\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.734158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.734140    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.734310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.734292    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.734435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.734419    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.836325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.836292    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.836608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.836589    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.836695 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.836685    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lc9\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.836824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.836800    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.836940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.836929    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837018    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837169 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837160    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837234 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837225    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837288    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837384    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837523    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837779 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837763    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.837881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.837811    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.838031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.838011    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.839905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.839886    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.841309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.841274    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.860256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.860200    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.860338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.860304    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lc9\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:35.953166 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:35.953103    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:36.139370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.139016    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 07:11:36.139370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.139065    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 07:11:36.339173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.339125    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 07:11:36.339372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.339200    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 07:11:36.344622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.344593    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"]
Oct 30 07:11:36.348953 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:11:36.348919    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191b6ce6_8636_4426_a602_b608fa3d51d1.slice/crio-0745ac672450babff2cdd4e95abf6e8efad7c45ff8d00cf1954286019e5db7d5 WatchSource:0}: Error finding container 0745ac672450babff2cdd4e95abf6e8efad7c45ff8d00cf1954286019e5db7d5: Status 404 returned error can't find the container with id 0745ac672450babff2cdd4e95abf6e8efad7c45ff8d00cf1954286019e5db7d5
Oct 30 07:11:36.351539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.351508    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:36.351638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.351568    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:36.351638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.351601    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:36.418564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:36.418533    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" event={"ID":"191b6ce6-8636-4426-a602-b608fa3d51d1","Type":"ContainerStarted","Data":"0745ac672450babff2cdd4e95abf6e8efad7c45ff8d00cf1954286019e5db7d5"}
Oct 30 07:11:37.570474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.570433    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" event={"ID":"191b6ce6-8636-4426-a602-b608fa3d51d1","Type":"ContainerStarted","Data":"a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08"}
Oct 30 07:11:37.655485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.655456    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:37.657944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.657922    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:37.659249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.659220    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 07:11:37.707668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.707608    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podStartSLOduration=2.7075871449999998 podStartE2EDuration="2.707587145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:11:37.668353253 +0000 UTC m=+900.376233422" watchObservedRunningTime="2026-10-30 07:11:37.707587145 +0000 UTC m=+900.415467315"
Oct 30 07:11:37.725607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.725572    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:11:37.728157 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.728131    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:11:37.779254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.779215    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:37.796888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.791097    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:37.811884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.810843    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:11:37.953405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.953370    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:37.971036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.969175    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 07:11:37.971036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:37.969228    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 07:11:38.954143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:38.954107    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 07:11:38.954693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:38.954655    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 07:11:39.953552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:39.953511    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 07:11:39.953769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:39.953568    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 07:11:40.953402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:40.953362    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 07:11:40.953901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:40.953426    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 07:11:41.953500 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:41.953464    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 07:11:41.954019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:41.953513    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 07:11:42.953724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:42.953689    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 07:11:42.954251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:42.953745    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 07:11:43.302521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.302433    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"]
Oct 30 07:11:43.308480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.308450    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.343280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.343254    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"]
Oct 30 07:11:43.462640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.462588    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.462822 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.462793    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.462917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.462825    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.462980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.462955    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4mj\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.463050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.463030    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.463104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.463081    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.463246 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.463225    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.463297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.463268    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.463386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.463370    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565227    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565282    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565328    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565381    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565529    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565557    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565610    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4mj\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565672    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565698    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.565951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.565924    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.566037 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.566017    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.566252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.566226    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.566394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.566364    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.566486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.566462    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.568485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.568467    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.568882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.568843    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.589328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.589243    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4mj\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.589455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.589428    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.643351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:43.643324    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:43.981337 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:11:43.981296    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:11:44.016903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.009317    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"]
Oct 30 07:11:44.017168 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:11:44.017139    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74015b23_decf_4839_b672_4c32b596c6cf.slice/crio-54aeb561dec083dc9cd9feeb92542a3be4a12aa00fbd1ce53b96c5b115dcfa3b WatchSource:0}: Error finding container 54aeb561dec083dc9cd9feeb92542a3be4a12aa00fbd1ce53b96c5b115dcfa3b: Status 404 returned error can't find the container with id 54aeb561dec083dc9cd9feeb92542a3be4a12aa00fbd1ce53b96c5b115dcfa3b
Oct 30 07:11:44.020299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.020272    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:44.020552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.020381    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:44.020777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.020749    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:44.020981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.020959    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:11:44.021107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.021086    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:44.022409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.022395    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:11:44.674997 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.674962    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" event={"ID":"74015b23-decf-4839-b672-4c32b596c6cf","Type":"ContainerStarted","Data":"521db7857e72015dd44d387539e12b723961359dcd2d4b388ce5b405a6d8eaf3"}
Oct 30 07:11:44.675272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.675249    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" event={"ID":"74015b23-decf-4839-b672-4c32b596c6cf","Type":"ContainerStarted","Data":"54aeb561dec083dc9cd9feeb92542a3be4a12aa00fbd1ce53b96c5b115dcfa3b"}
Oct 30 07:11:44.723236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:44.723182    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podStartSLOduration=1.723166724 podStartE2EDuration="1.723166724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:11:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:11:44.721285996 +0000 UTC m=+907.429166166" watchObservedRunningTime="2026-10-30 07:11:44.723166724 +0000 UTC m=+907.431046893"
Oct 30 07:11:45.644458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:45.644425    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:45.645937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:45.645907    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:45.646060 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:45.645960    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:46.653873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:46.651944    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:46.653873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:46.652002    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:47.702055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:47.695603    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:47.702055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:47.695687    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:47.850022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:47.849968    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:47.955099 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:47.954994    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:47.955709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:47.955679    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:48.644930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:48.644455    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:48.644930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:48.644519    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:48.681004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:48.680957    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:11:48.723002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:48.722956    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:48.860939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:48.858585    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:48.860939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:48.859046    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:11:49.692600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.691013    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:49.692600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.691082    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:49.692600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.691501    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:49.776879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.775258    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:49.797999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.795321    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:11:49.797999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.795392    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:11:50.002931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.961908    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:50.057123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:49.965017    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:11:50.553880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.547739    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:11:50.554281 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.554239    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:50.645824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.645775    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:50.646149 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.646117    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:50.735880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.711182    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:50.841112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.783813    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:50.990878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.987293    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:11:50.990878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:50.987373    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:51.119933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.094827    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:11:51.128888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.123484    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:51.128888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.123920    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:11:51.139405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.138918    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:11:51.624990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.624946    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": context deadline exceeded"
Oct 30 07:11:51.649445 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.649409    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:51.649748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.649717    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:51.843108 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.843055    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:51.844112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.844079    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:11:51.925979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:51.925927    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:11:52.128882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.126941    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:11:52.128882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.127349    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:11:52.150109 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.149039    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:11:52.215694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.215612    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:11:52.351643 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.351114    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:11:52.354900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.354703    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:11:52.644000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.643878    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:52.644000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:52.643932    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:53.644612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:53.644572    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:53.645120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:53.644630    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:54.644001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:54.643958    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 07:11:54.644198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:54.644030    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 07:11:55.648660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:55.648622    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:55.649079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:55.648903    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:11:55.649617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:11:55.649597    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:12:02.304566 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.304521    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"]
Oct 30 07:12:02.309646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.309618    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.337931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.337846    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a6a14e07-serving-cert\""
Oct 30 07:12:02.353808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.353768    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"]
Oct 30 07:12:02.387839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.387794    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.388199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.388177    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.388481 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.388464    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.388731 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.388715    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sshh\" (UniqueName: \"kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.489746 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.489709    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.489961 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.489936    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.490765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.490145    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sshh\" (UniqueName: \"kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.490765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.490338    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.491351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.491320    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.492833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.492811    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.493036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.493016    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.513414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.513374    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sshh\" (UniqueName: \"kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh\") pod \"maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.626182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.626148    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:02.951384 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:12:02.951355    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cdf0e7_164e_4365_bca3_a5f04fef548e.slice/crio-99ae34a53dd5f26e3fbfd5dcbb2c22f48b8a2a52a6e263b7070748716baed2ff WatchSource:0}: Error finding container 99ae34a53dd5f26e3fbfd5dcbb2c22f48b8a2a52a6e263b7070748716baed2ff: Status 404 returned error can't find the container with id 99ae34a53dd5f26e3fbfd5dcbb2c22f48b8a2a52a6e263b7070748716baed2ff
Oct 30 07:12:02.951742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.951698    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"]
Oct 30 07:12:02.952675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:02.952659    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:12:03.502081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:03.498294    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf" event={"ID":"96cdf0e7-164e-4365-bca3-a5f04fef548e","Type":"ContainerStarted","Data":"99ae34a53dd5f26e3fbfd5dcbb2c22f48b8a2a52a6e263b7070748716baed2ff"}
Oct 30 07:12:04.511040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:04.511001    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf" event={"ID":"96cdf0e7-164e-4365-bca3-a5f04fef548e","Type":"ContainerStarted","Data":"239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2"}
Oct 30 07:12:04.511423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:04.511247    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:04.553836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:04.553789    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf" podStartSLOduration=2.066630814 podStartE2EDuration="2.553776682s" totalImagesPullingTime="487.145868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:04.552289312 +0000 UTC m=+927.260169483" watchObservedRunningTime="2026-10-30 07:12:04.553776682 +0000 UTC m=+927.261656851"
Oct 30 07:12:07.843920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:07.842723    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:07.952395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:07.952338    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": context deadline exceeded"
Oct 30 07:12:08.128711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:08.128673    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:12:08.915878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:08.909656    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:08.915878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:08.910133    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:12:08.915878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:08.910790    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:12:08.938473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:08.938331    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:12:08.938473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:08.938388    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:09.243007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:09.237011    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:12:09.263909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:09.263438    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:12:09.304880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:09.292468    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:12:09.939910 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:09.923666    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:09.939910 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:09.924353    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:12:09.946961 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:09.946930    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:12:10.314928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:10.312827    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:12:10.337885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:10.320929    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:12:10.337885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:10.321464    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:12:10.720884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:10.714477    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:12:10.941876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:10.941716    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:12:10.942380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:10.942126    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:12:11.094932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.094665    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:11.314006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.313955    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:11.334244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.334202    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:12:11.384924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.384876    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:11.775464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.775017    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:12:11.775464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.775088    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:11.931436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.930967    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": context deadline exceeded"
Oct 30 07:12:11.947143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.945403    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:12:11.947143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:11.946780    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:12:12.319044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:12.318989    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:12.339983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:12.339934    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:12.990876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:12.973985    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:12:12.990876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:12.985106    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:12:13.257604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.257509    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"]
Oct 30 07:12:13.325491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.325440    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:13.347004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.344046    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:13.589936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.589083    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"]
Oct 30 07:12:13.608969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.597745    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.685088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.679177    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a163b2-dockercfg-kr2lb\""
Oct 30 07:12:13.689068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.686417    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a163b2\""
Oct 30 07:12:13.689213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.688085    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wqk\" (UniqueName: \"kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk\") pod \"payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") " pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.689571 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.689554    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") " pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.826886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.803740    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") " pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.826886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.803929    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wqk\" (UniqueName: \"kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk\") pod \"payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") " pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.852823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.830062    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") " pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.918680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.885603    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wqk\" (UniqueName: \"kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk\") pod \"payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") " pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:13.969276 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:13.919592    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:12:14.010168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:14.010122    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:14.164887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:14.160314    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:14.236812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:14.236782    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:12:14.260942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:14.260913    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:12:14.348019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:14.347978    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:14.530750 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:14.530669    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:12:14.654194 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:12:14.650625    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:12:15.088389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:15.088348    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"]
Oct 30 07:12:15.090249 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:12:15.090205    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode848cbfd_70c8_468a_8fd2_974321615fa7.slice/crio-68008d2f35a045d558aa3619d3604cbe7259971d7a3bbcc05ccea81433e2e5b6 WatchSource:0}: Error finding container 68008d2f35a045d558aa3619d3604cbe7259971d7a3bbcc05ccea81433e2e5b6: Status 404 returned error can't find the container with id 68008d2f35a045d558aa3619d3604cbe7259971d7a3bbcc05ccea81433e2e5b6
Oct 30 07:12:15.401265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:15.401139    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz" event={"ID":"e848cbfd-70c8-468a-8fd2-974321615fa7","Type":"ContainerStarted","Data":"3c48acde2dc45b0d7d156f7d9c83fe2e7297bd6d8b59d337cc81b0931e9865d9"}
Oct 30 07:12:15.401265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:15.401231    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz" event={"ID":"e848cbfd-70c8-468a-8fd2-974321615fa7","Type":"ContainerStarted","Data":"68008d2f35a045d558aa3619d3604cbe7259971d7a3bbcc05ccea81433e2e5b6"}
Oct 30 07:12:15.401486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:15.401341    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:15.443472 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:15.443420    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz" podStartSLOduration=2.4434037 podStartE2EDuration="2.4434037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:15.440211543 +0000 UTC m=+938.148091732" watchObservedRunningTime="2026-10-30 07:12:15.4434037 +0000 UTC m=+938.151283869"
Oct 30 07:12:18.260380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.260290    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"]
Oct 30 07:12:18.264993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.264971    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.279281 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.279257    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 07:12:18.279391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.279333    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 07:12:18.279391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.279371    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 07:12:18.290458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.290436    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xjg2r\""
Oct 30 07:12:18.296210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.296183    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"]
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301553    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301604    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301647    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301868    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301926    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301963    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.304067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.301990    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcghl\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403438    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403477    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403503    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403598    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403644    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403702    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.403959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.403743    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcghl\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.405019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.404991    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.405917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.405895    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.406174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.406144    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.406416 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.406396    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.406574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.406554    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.427393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.427361    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcghl\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.428023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.427987    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-84r29\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.579820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.579725    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:18.911839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:18.911808    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"]
Oct 30 07:12:18.912991 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:12:18.912964    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cebc3d8_995a_4153_b10b_a953f8fbdd30.slice/crio-a6cd3efcd6ded19589b1acfc6506617342fa408561d3a7a39128d49b2bcd0749 WatchSource:0}: Error finding container a6cd3efcd6ded19589b1acfc6506617342fa408561d3a7a39128d49b2bcd0749: Status 404 returned error can't find the container with id a6cd3efcd6ded19589b1acfc6506617342fa408561d3a7a39128d49b2bcd0749
Oct 30 07:12:19.436489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:19.436456    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" event={"ID":"5cebc3d8-995a-4153-b10b-a953f8fbdd30","Type":"ContainerStarted","Data":"a6cd3efcd6ded19589b1acfc6506617342fa408561d3a7a39128d49b2bcd0749"}
Oct 30 07:12:20.906829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:20.906796    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"]
Oct 30 07:12:20.915609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:20.915586    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:20.944377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:20.942442    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"]
Oct 30 07:12:21.059699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.059663    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.059912 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.059724    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8jtn\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.059998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.059921    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.059998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.059972    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.060085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.060064    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.060158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.060133    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.060320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.060301    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.060433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.060381    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.060433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.060414    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.161929    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8jtn\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162012    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162038    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162067    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162131    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162246    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162307    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162333    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162362    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162511    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162539    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162719 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162694    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162794    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.162965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.162932    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.164692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.164670    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.165153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.165131    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.184953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.184898    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.185599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.185575    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8jtn\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.246120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.246086    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:21.644069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.624429    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"]
Oct 30 07:12:21.663776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.663735    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:21.664060 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.664034    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:21.664241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.664224    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:21.844447 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.844409    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:21.844572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:21.844494    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:22.469817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.468087    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" event={"ID":"5cebc3d8-995a-4153-b10b-a953f8fbdd30","Type":"ContainerStarted","Data":"171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f"}
Oct 30 07:12:22.469817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.469765    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:22.477732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.476507    5073 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-84r29 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:12:22.477732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.476561    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" podUID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:12:22.477732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.477525    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" event={"ID":"39fb21ec-bc5a-495d-84c6-29a4b7f74541","Type":"ContainerStarted","Data":"3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331"}
Oct 30 07:12:22.477732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.477582    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" event={"ID":"39fb21ec-bc5a-495d-84c6-29a4b7f74541","Type":"ContainerStarted","Data":"b45ac0480dd3d4f6b7dcd2eb64343de17fee5913866af0dcbe73654cfe17664f"}
Oct 30 07:12:22.564530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:22.564453    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" podStartSLOduration=1.638594479 podStartE2EDuration="4.564433679s" totalImagesPullingTime="2.9258392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:22.561471206 +0000 UTC m=+945.269351401" watchObservedRunningTime="2026-10-30 07:12:22.564433679 +0000 UTC m=+945.272313852"
Oct 30 07:12:23.172873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.171920    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podStartSLOduration=3.171898402 podStartE2EDuration="3.171898402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:22.62848496 +0000 UTC m=+945.336365130" watchObservedRunningTime="2026-10-30 07:12:23.171898402 +0000 UTC m=+945.879778571"
Oct 30 07:12:23.511944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.494293    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"]
Oct 30 07:12:23.511944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.494378    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:23.511944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.494567    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" containerID="cri-o://203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d" gracePeriod=30
Oct 30 07:12:23.554044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.554010    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:23.554281 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.554253    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:23.609924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.609891    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"]
Oct 30 07:12:23.610604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.610572    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" containerID="cri-o://6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058" gracePeriod=30
Oct 30 07:12:23.614365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:23.614315    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:12:24.251325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:24.251279    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:24.251627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:24.251595    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:25.084879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:25.050106    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:12:25.260935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:25.252322    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:25.260935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:25.252391    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:25.330413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:25.330372    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 30 07:12:25.964930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:25.939587    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:12:26.147442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:26.147382    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:12:26.149955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:26.149350    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:12:26.261570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:26.248833    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:26.261570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:26.248923    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:26.539949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:26.523642    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:12:26.945786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:26.945755    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 07:12:27.246643 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:27.246549    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:27.247300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:27.247251    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:28.246563 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:28.246524    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:28.246738 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:28.246583    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:29.208950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.208912    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"]
Oct 30 07:12:29.213657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.213633    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.245773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.245741    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"]
Oct 30 07:12:29.247162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.247134    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:29.247555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.247193    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:29.337470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337430    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.337470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337477    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.337720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337555    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.337720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337644    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.337720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337706    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9btzk\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.337916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337803    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.337916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337905    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.338039 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.337945    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.338146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.338128    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.439755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.439723    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.439956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.439766    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.439956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.439910    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.439956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.439944    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.439985    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9btzk\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440238    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440265    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440317    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440354    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440497 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440451    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440549 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440492    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440631    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.440757 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.440738    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.441422 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.441399    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.442167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.442137    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.442765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.442747    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.462786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.462731    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.462921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.462811    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9btzk\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.532958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.532926    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:29.876267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.876234    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"]
Oct 30 07:12:29.882582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.882550    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:29.882700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.882610    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:29.882700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:29.882637    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:30.246619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:30.246574    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 07:12:30.246795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:30.246638    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 07:12:30.898022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:30.897979    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" event={"ID":"63cb7d10-6130-42c2-b848-69f5b77e8fd9","Type":"ContainerStarted","Data":"72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46"}
Oct 30 07:12:30.898624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:30.898596    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" event={"ID":"63cb7d10-6130-42c2-b848-69f5b77e8fd9","Type":"ContainerStarted","Data":"96f3aef35e0c72f4104da64eb0434ecfeb51abf26cc0d57556619c0d75b0f57b"}
Oct 30 07:12:30.968411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:30.968337    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podStartSLOduration=1.968319232 podStartE2EDuration="1.968319232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:30.966378234 +0000 UTC m=+953.674258403" watchObservedRunningTime="2026-10-30 07:12:30.968319232 +0000 UTC m=+953.676199405"
Oct 30 07:12:31.212275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.212173    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-h7xgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:12:31.212555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.212508    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:12:31.239145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.236615    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-22jpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:12:31.239145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.236692    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:12:31.261453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.261422    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:31.261925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.261879    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:31.263836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.262695    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:12:31.533995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.533905    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:31.535136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.535108    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 07:12:31.535257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:31.535161    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 07:12:32.546922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.539418    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 07:12:32.546922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.539711    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 07:12:32.749256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.749223    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:12:32.840660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.840621    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.840832 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.840688    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.840937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.840843    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.840937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.840929    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.841056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.840957    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.841056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.841005    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.841156 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.841101    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.841212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.841161    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.841212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.841201    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy\") pod \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\" (UID: \"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b\") "
Oct 30 07:12:32.842382 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.842354    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:32.842565 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.842453    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:32.842656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.842630    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:32.843081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.843057    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:12:32.843309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.843285    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:32.845606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.845577    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "kube-api-access-m58bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:12:32.846253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.846222    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:12:32.848153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.848131    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:32.848420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.848402    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token" pod "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" (UID: "c01286ad-b10e-4cb4-b2b1-46ad89d3c27b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:12:32.941603 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.941574    5073 generic.go:356] "Generic (PLEG): container finished" podID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerID="203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d" exitCode=0
Oct 30 07:12:32.941768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.941621    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"
Oct 30 07:12:32.941768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.941661    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" event={"ID":"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b","Type":"ContainerDied","Data":"203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d"}
Oct 30 07:12:32.941768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.941734    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl" event={"ID":"c01286ad-b10e-4cb4-b2b1-46ad89d3c27b","Type":"ContainerDied","Data":"a482763c994593948602fddb77b60168de14e8e9c269f23a5da415d7612a5e52"}
Oct 30 07:12:32.941768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.941762    5073 scope.go:122] "RemoveContainer" containerID="203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d"
Oct 30 07:12:32.942777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942753    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m58bj\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-kube-api-access-m58bj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942774    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942783    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942791    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942800    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942808    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942815    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942822    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.942986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.942831    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:32.957651 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.957622    5073 scope.go:122] "RemoveContainer" containerID="203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d"
Oct 30 07:12:32.958046 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:12:32.958020    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d\": container with ID starting with 203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d not found: ID does not exist" containerID="203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d"
Oct 30 07:12:32.958162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:32.958058    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d"} err="failed to get container status \"203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d\": rpc error: code = NotFound desc = could not find container \"203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d\": container with ID starting with 203eaa41af6deabf504ed815197b227d54742ebed634ed43195e54da1ca2224d not found: ID does not exist"
Oct 30 07:12:33.031207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.031163    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"]
Oct 30 07:12:33.041947 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.041399    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-22jpl"]
Oct 30 07:12:33.469281 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.469247    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" path="/var/lib/kubelet/pods/c01286ad-b10e-4cb4-b2b1-46ad89d3c27b/volumes"
Oct 30 07:12:33.521588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.521512    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:12:33.533605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.533572    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 07:12:33.533735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.533627    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 07:12:33.659684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.659653    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.659699    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.659734    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.659812    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.659836    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.659922    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660028    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660060    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660339    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:33.660590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660397    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2\") pod \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\" (UID: \"2c80e0f0-c8de-4b70-aea3-4838ab726f8b\") "
Oct 30 07:12:33.660696 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660643    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:33.660777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660629    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:33.661134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.660968    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:12:33.661134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.661083    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:33.661418 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.661395    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.661489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.661424    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.661489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.661439    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.661489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.661453    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.661489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.661466    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.663123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.663098    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:12:33.663527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.663507    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:12:33.663973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.663949    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:12:33.664175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.664151    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2" pod "2c80e0f0-c8de-4b70-aea3-4838ab726f8b" (UID: "2c80e0f0-c8de-4b70-aea3-4838ab726f8b"). InnerVolumeSpecName "kube-api-access-hgqx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:12:33.762960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.762925    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgqx2\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-kube-api-access-hgqx2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.762960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.762954    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.762960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.762964    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.763193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.762977    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c80e0f0-c8de-4b70-aea3-4838ab726f8b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:12:33.958398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.958352    5073 generic.go:356] "Generic (PLEG): container finished" podID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerID="6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058" exitCode=0
Oct 30 07:12:33.958595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.958522    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" event={"ID":"2c80e0f0-c8de-4b70-aea3-4838ab726f8b","Type":"ContainerDied","Data":"6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058"}
Oct 30 07:12:33.958665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.958614    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz" event={"ID":"2c80e0f0-c8de-4b70-aea3-4838ab726f8b","Type":"ContainerDied","Data":"97c146aea88684665c4a32cdaad3caba8b4577854faa1941f1ee1b03f9b92cb8"}
Oct 30 07:12:33.958665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.958652    5073 scope.go:122] "RemoveContainer" containerID="6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058"
Oct 30 07:12:33.958867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:33.958836    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"
Oct 30 07:12:34.012827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:34.012511    5073 scope.go:122] "RemoveContainer" containerID="6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058"
Oct 30 07:12:34.013562 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:12:34.013446    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058\": container with ID starting with 6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058 not found: ID does not exist" containerID="6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058"
Oct 30 07:12:34.013562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:34.013487    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058"} err="failed to get container status \"6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058\": rpc error: code = NotFound desc = could not find container \"6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058\": container with ID starting with 6e9640a5efb6fb96dca95b47fdf0e112c3a8b101f184e5568bb5a6df0dd8f058 not found: ID does not exist"
Oct 30 07:12:34.048267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:34.047538    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"]
Oct 30 07:12:34.051377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:34.051305    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-h7xgz"]
Oct 30 07:12:34.534186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:34.534155    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 07:12:34.534341 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:34.534205    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 07:12:35.424050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:35.424018    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" path="/var/lib/kubelet/pods/2c80e0f0-c8de-4b70-aea3-4838ab726f8b/volumes"
Oct 30 07:12:35.534128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:35.534094    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 07:12:35.534297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:35.534146    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 07:12:36.533583 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:36.533544    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 07:12:36.534004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:36.533610    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 07:12:37.537716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:37.537675    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:37.538156 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:37.538133    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:37.538785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:37.538766    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:12:38.241808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.241772    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"]
Oct 30 07:12:38.242467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.242451    5073 cpu_manager.go:414] "containerMap: removing container" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy"
Oct 30 07:12:38.242517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.242468    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy"
Oct 30 07:12:38.242517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.242481    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy"
Oct 30 07:12:38.242517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.242486    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy"
Oct 30 07:12:38.242629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.242619    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="c01286ad-b10e-4cb4-b2b1-46ad89d3c27b" containerName="istio-proxy"
Oct 30 07:12:38.242661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.242630    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c80e0f0-c8de-4b70-aea3-4838ab726f8b" containerName="istio-proxy"
Oct 30 07:12:38.247573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.247553    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.273845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.273805    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"]
Oct 30 07:12:38.283156 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.283127    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"]
Oct 30 07:12:38.288072 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.288050    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.326792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.326760    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"]
Oct 30 07:12:38.367558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367451    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbwd\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.367558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367527    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.367558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367558    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.367813 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367624    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.367813 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367718    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.367813 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367765    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.367925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367879    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.367925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367904    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.367932    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.368058 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368044    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t92l2\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368096 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368079    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368133    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368166    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.368253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368234    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368279    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.368392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368379    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368408    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.368433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.368430    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.469995    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470038    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470064    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470106    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470148    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470179    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470247    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glbwd\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470311    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470340    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470415    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470457    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470483    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470498    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470565    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470575    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470563    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470636    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470691    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470773    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t92l2\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.470885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470827    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.471221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470886    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.471221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.470906    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.471221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.471160    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.471221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.471169    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.471221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.471182    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.471450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.471330    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.471450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.471389    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.472131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.472070    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.473034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.472953    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.473799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.473766    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.474156 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.474128    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.474331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.474311    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.493494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.493417    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.493606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.493499    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.493606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.493503    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbwd\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd\") pod \"maas-default-gateway-openshift-default-6dcf757899-6cm4m\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.493606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.493542    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t92l2\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2\") pod \"maas-default-gateway-openshift-default-6dcf757899-kt2r2\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.561880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.561820    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:38.628274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.628226    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:38.891300 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:12:38.891271    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7b1505_6afc_4b76_abf4_03784f23f292.slice/crio-0dfa9cb9f9830d928f9983ff6d102e8ed9c334d2068cfd44595b8c36abd0f7c8 WatchSource:0}: Error finding container 0dfa9cb9f9830d928f9983ff6d102e8ed9c334d2068cfd44595b8c36abd0f7c8: Status 404 returned error can't find the container with id 0dfa9cb9f9830d928f9983ff6d102e8ed9c334d2068cfd44595b8c36abd0f7c8
Oct 30 07:12:38.891734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.891711    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"]
Oct 30 07:12:38.894265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.894233    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:38.894375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.894292    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:38.894375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.894321    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:38.985486 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.985458    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"]
Oct 30 07:12:38.985748 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:12:38.985720    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61798c7b_2ae7_4d0c_affe_2095cf6b165b.slice/crio-0551dbbef90a16fa547e404451392d0aa26f56c17a266e3eb3cedeaa15f4116a WatchSource:0}: Error finding container 0551dbbef90a16fa547e404451392d0aa26f56c17a266e3eb3cedeaa15f4116a: Status 404 returned error can't find the container with id 0551dbbef90a16fa547e404451392d0aa26f56c17a266e3eb3cedeaa15f4116a
Oct 30 07:12:38.988487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.988456    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:38.988586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.988534    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:38.988586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:38.988563    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:12:39.052677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:39.052587    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" event={"ID":"9b7b1505-6afc-4b76-abf4-03784f23f292","Type":"ContainerStarted","Data":"b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239"}
Oct 30 07:12:39.052677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:39.052635    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" event={"ID":"9b7b1505-6afc-4b76-abf4-03784f23f292","Type":"ContainerStarted","Data":"0dfa9cb9f9830d928f9983ff6d102e8ed9c334d2068cfd44595b8c36abd0f7c8"}
Oct 30 07:12:39.055400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:39.055370    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" event={"ID":"61798c7b-2ae7-4d0c-affe-2095cf6b165b","Type":"ContainerStarted","Data":"0551dbbef90a16fa547e404451392d0aa26f56c17a266e3eb3cedeaa15f4116a"}
Oct 30 07:12:39.562873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:39.562214    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:39.588876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:39.585996    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:39.588876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:39.586063    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:40.147877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.147114    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" event={"ID":"61798c7b-2ae7-4d0c-affe-2095cf6b165b","Type":"ContainerStarted","Data":"969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee"}
Oct 30 07:12:40.225878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.213267    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podStartSLOduration=2.21324363 podStartE2EDuration="2.21324363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:39.099604285 +0000 UTC m=+961.807484458" watchObservedRunningTime="2026-10-30 07:12:40.21324363 +0000 UTC m=+962.921123799"
Oct 30 07:12:40.361916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.360816    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podStartSLOduration=2.360801096 podStartE2EDuration="2.360801096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:40.268445493 +0000 UTC m=+962.976325690" watchObservedRunningTime="2026-10-30 07:12:40.360801096 +0000 UTC m=+963.068681269"
Oct 30 07:12:40.563557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.563448    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:40.563557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.563534    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:40.630878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.629999    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:40.634874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.632315    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:40.634874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:40.632397    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:41.602622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:41.602176    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:41.602622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:41.602239    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:41.677889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:41.654980    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:41.677889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:41.655033    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:42.562477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:42.562448    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:42.562621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:42.562502    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:42.630154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:42.628838    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:42.630154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:42.628917    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:43.562309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:43.562273    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:43.562497 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:43.562332    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:43.629929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:43.629886    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:43.630432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:43.630388    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:43.956788 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:12:43.956750    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:12:44.563273 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:44.563238    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:44.563491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:44.563469    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:44.631388 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:44.631352    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:44.631962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:44.631929    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:45.562459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:45.562417    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:45.562661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:45.562486    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:45.629205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:45.629170    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:45.629387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:45.629251    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:46.563145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:46.563102    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 07:12:46.563602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:46.563163    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 07:12:46.629005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:46.628966    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 07:12:46.629162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:46.629029    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 07:12:48.323264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:48.323232    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:48.324424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:48.324394    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:48.326908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:48.326847    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:12:48.404995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:48.404959    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:48.405668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:48.405626    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:48.408478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:48.408449    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:12:52.250761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.250727    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"]
Oct 30 07:12:52.256549 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.256527    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.284409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.284376    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3bda71-serving-cert\""
Oct 30 07:12:52.288288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.288262    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"]
Oct 30 07:12:52.348087 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.348048    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.348556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.348110    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.348556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.348304    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.348556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.348409    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn47v\" (UniqueName: \"kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.449891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.449832    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.450074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.449957    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn47v\" (UniqueName: \"kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.450167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.450144    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.450295 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.450187    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.451061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.451037    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.453110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.453085    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.453384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.453368    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.474294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.474263    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn47v\" (UniqueName: \"kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v\") pod \"maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.574222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.574118    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:12:52.947379 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:12:52.947345    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea90628e_f856_4903_be52_0cde15a604e2.slice/crio-6f4c936b32322d958c78d71036623bd427748d361aa6b93116238847244c5c78 WatchSource:0}: Error finding container 6f4c936b32322d958c78d71036623bd427748d361aa6b93116238847244c5c78: Status 404 returned error can't find the container with id 6f4c936b32322d958c78d71036623bd427748d361aa6b93116238847244c5c78
Oct 30 07:12:52.947820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:52.947797    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"]
Oct 30 07:12:53.816420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:53.816352    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995" event={"ID":"ea90628e-f856-4903-be52-0cde15a604e2","Type":"ContainerStarted","Data":"3fea136b155736ea3981ce2c64d6b32158344708eb1fb862554757ac5fa841b1"}
Oct 30 07:12:53.816420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:53.816416    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995" event={"ID":"ea90628e-f856-4903-be52-0cde15a604e2","Type":"ContainerStarted","Data":"6f4c936b32322d958c78d71036623bd427748d361aa6b93116238847244c5c78"}
Oct 30 07:12:53.817545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:12:53.817518    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:13:00.835464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:00.835434    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:13:00.885220 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:00.885166    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995" podStartSLOduration=8.549869065 podStartE2EDuration="8.885152006s" totalImagesPullingTime="335.282941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:12:53.866110778 +0000 UTC m=+976.573990968" watchObservedRunningTime="2026-10-30 07:13:00.885152006 +0000 UTC m=+983.593032174"
Oct 30 07:13:13.929568 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:13:13.929527    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:13:17.330516 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.330478    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"]
Oct 30 07:13:17.339901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.339870    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.355473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.355441    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"]
Oct 30 07:13:17.362290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.362264    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f357db-openshift-default-dockercfg-ms9s2\""
Oct 30 07:13:17.419770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.419726    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.419786    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.419839    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.420032    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkfz\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.420133    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.420167    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.420253    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.420288    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.420340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.420337    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.522548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.522503    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.525100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.525060    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.525343 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.525314    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.525523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.525504    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.525706 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.525688    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.525830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.525815    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.525994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.525977    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.526269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.526252    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkfz\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.526470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.526453    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.528270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.528023    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.530128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.530097    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.530940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.530919    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.531348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.531327    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.534131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.532074    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.559702 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.559640    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.580416 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.580340    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.606924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.597332    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkfz\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.616876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.612426    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token\") pod \"e2e-api-b-f357db-openshift-default-777c66bcc-4486p\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") " pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:17.669358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:17.668142    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:18.053533 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:13:18.053504    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18598b60_9d3f_40e3_a41c_9a549153358d.slice/crio-a57d63d6420a05642c1952ac730b625876e8d4845541a96cd3ad8cca15ea5ab4 WatchSource:0}: Error finding container a57d63d6420a05642c1952ac730b625876e8d4845541a96cd3ad8cca15ea5ab4: Status 404 returned error can't find the container with id a57d63d6420a05642c1952ac730b625876e8d4845541a96cd3ad8cca15ea5ab4
Oct 30 07:13:18.054561 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:18.054540    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"]
Oct 30 07:13:18.055836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:18.055806    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:13:18.055929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:18.055883    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:13:18.055929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:18.055911    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:13:19.024815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:19.024779    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" event={"ID":"18598b60-9d3f-40e3-a41c-9a549153358d","Type":"ContainerStarted","Data":"a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"}
Oct 30 07:13:19.025256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:19.024838    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" event={"ID":"18598b60-9d3f-40e3-a41c-9a549153358d","Type":"ContainerStarted","Data":"a57d63d6420a05642c1952ac730b625876e8d4845541a96cd3ad8cca15ea5ab4"}
Oct 30 07:13:19.091591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:19.091534    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podStartSLOduration=2.091519403 podStartE2EDuration="2.091519403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:13:19.087968905 +0000 UTC m=+1001.795849075" watchObservedRunningTime="2026-10-30 07:13:19.091519403 +0000 UTC m=+1001.799399621"
Oct 30 07:13:19.669712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:19.669681    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:19.675366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:19.675341    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:20.039812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:20.039737    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:20.040944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:20.040922    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:13:42.958029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:42.957995    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"]
Oct 30 07:13:42.964152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:42.964129    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:42.982628 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:42.982604    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"]
Oct 30 07:13:42.989708 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:42.989655    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f357db-serving-cert\""
Oct 30 07:13:43.138288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.138250    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.138489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.138469    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.138602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.138582    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6hh4\" (UniqueName: \"kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.138701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.138687    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.240568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.240478    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.240762 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.240585    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6hh4\" (UniqueName: \"kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.240762 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.240685    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.240762 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.240732    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.241595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.241563    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.243708 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.243679    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.245060 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.245034    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.265879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.263581    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6hh4\" (UniqueName: \"kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4\") pod \"maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.279023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.278986    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:43.621266 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:13:43.621240    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05739dba_a179_4358_ad7c_9f006fab47cb.slice/crio-59c72cbd9f3daaeca62c58251386a349f93219bf0d7fb01dd3c7142be7eadd37 WatchSource:0}: Error finding container 59c72cbd9f3daaeca62c58251386a349f93219bf0d7fb01dd3c7142be7eadd37: Status 404 returned error can't find the container with id 59c72cbd9f3daaeca62c58251386a349f93219bf0d7fb01dd3c7142be7eadd37
Oct 30 07:13:43.622498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:43.622476    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"]
Oct 30 07:13:43.923689 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:13:43.923650    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:13:44.308534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.308444    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw" event={"ID":"05739dba-a179-4358-ad7c-9f006fab47cb","Type":"ContainerStarted","Data":"1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a"}
Oct 30 07:13:44.308534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.308496    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw" event={"ID":"05739dba-a179-4358-ad7c-9f006fab47cb","Type":"ContainerStarted","Data":"59c72cbd9f3daaeca62c58251386a349f93219bf0d7fb01dd3c7142be7eadd37"}
Oct 30 07:13:44.309029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.308622    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:44.384836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.384350    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw" podStartSLOduration=1.9273492079999999 podStartE2EDuration="2.384331079s" totalImagesPullingTime="456.981871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:13:44.351293593 +0000 UTC m=+1027.059173782" watchObservedRunningTime="2026-10-30 07:13:44.384331079 +0000 UTC m=+1027.092211249"
Oct 30 07:13:44.469919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.465291    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"]
Oct 30 07:13:44.487867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.487801    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.496005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.495967    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"]
Oct 30 07:13:44.563716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.563420    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.563716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.563604    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.563716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.563689    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq755\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.564033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.563757    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.564033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.563817    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.564033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.563948    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.564202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.564061    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.564202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.564145    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.564306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.564220    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.665791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.665753    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.665829    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq755\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.665928    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.665976    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666053    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666143    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666209    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666274    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666293    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666404    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666416    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666443    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.666706 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.666690    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.667128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.667101    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.668622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.668593    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.668957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.668934    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.695111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.695077    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.695787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.695756    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq755\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:44.852116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:44.852037    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:45.198398 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:13:45.198367    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88272e24_340e_4863_aa87_989989c99ea4.slice/crio-a953c6f961d1d2c5d2058f02183c311a8ed7d5ddac7e2e41d0d15e2b839388b3 WatchSource:0}: Error finding container a953c6f961d1d2c5d2058f02183c311a8ed7d5ddac7e2e41d0d15e2b839388b3: Status 404 returned error can't find the container with id a953c6f961d1d2c5d2058f02183c311a8ed7d5ddac7e2e41d0d15e2b839388b3
Oct 30 07:13:45.200569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.200474    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"]
Oct 30 07:13:45.201727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.201688    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:13:45.201799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.201771    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:13:45.201841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.201813    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:13:45.318396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.318349    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" event={"ID":"88272e24-340e-4863-aa87-989989c99ea4","Type":"ContainerStarted","Data":"bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304"}
Oct 30 07:13:45.318396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.318468    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" event={"ID":"88272e24-340e-4863-aa87-989989c99ea4","Type":"ContainerStarted","Data":"a953c6f961d1d2c5d2058f02183c311a8ed7d5ddac7e2e41d0d15e2b839388b3"}
Oct 30 07:13:45.365703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.365644    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podStartSLOduration=1.365630062 podStartE2EDuration="1.365630062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:13:45.362293996 +0000 UTC m=+1028.070174165" watchObservedRunningTime="2026-10-30 07:13:45.365630062 +0000 UTC m=+1028.073510347"
Oct 30 07:13:45.852775 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:45.852741    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:46.854462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:46.854425    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 07:13:46.854865 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:46.854492    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 07:13:47.853115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:47.853032    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 07:13:47.853115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:47.853095    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 07:13:48.852438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:48.852397    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 07:13:48.852979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:48.852454    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 07:13:49.852640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:49.852607    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 07:13:49.853049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:49.852665    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 07:13:50.325251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:50.325218    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:13:50.852885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:50.852841    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 07:13:50.853268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:50.852904    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 07:13:51.853640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:51.853600    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 07:13:51.854302 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:51.854258    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 07:13:53.898715 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:53.898671    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:13:53.899394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:53.899354    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:13:54.053190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:54.053156    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:54.054998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:54.054975    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:54.073625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:54.073602    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:13:59.554236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:13:59.554196    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"]
Oct 30 07:14:04.554957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.554900    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz" podUID="e848cbfd-70c8-468a-8fd2-974321615fa7" containerName="payload-processing" containerID="cri-o://3c48acde2dc45b0d7d156f7d9c83fe2e7297bd6d8b59d337cc81b0931e9865d9" gracePeriod=25
Oct 30 07:14:04.785437 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.785399    5073 generic.go:356] "Generic (PLEG): container finished" podID="e848cbfd-70c8-468a-8fd2-974321615fa7" containerID="3c48acde2dc45b0d7d156f7d9c83fe2e7297bd6d8b59d337cc81b0931e9865d9" exitCode=0
Oct 30 07:14:04.785594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.785474    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz" event={"ID":"e848cbfd-70c8-468a-8fd2-974321615fa7","Type":"ContainerDied","Data":"3c48acde2dc45b0d7d156f7d9c83fe2e7297bd6d8b59d337cc81b0931e9865d9"}
Oct 30 07:14:04.859711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.859680    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:14:04.976671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.976638    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume\") pod \"e848cbfd-70c8-468a-8fd2-974321615fa7\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") "
Oct 30 07:14:04.976884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.976825    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk\" (UniqueName: \"kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk\") pod \"e848cbfd-70c8-468a-8fd2-974321615fa7\" (UID: \"e848cbfd-70c8-468a-8fd2-974321615fa7\") "
Oct 30 07:14:04.977240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.977141    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume" pod "e848cbfd-70c8-468a-8fd2-974321615fa7" (UID: "e848cbfd-70c8-468a-8fd2-974321615fa7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:14:04.977823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.977800    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e848cbfd-70c8-468a-8fd2-974321615fa7-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:14:04.979548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:04.979522    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk" pod "e848cbfd-70c8-468a-8fd2-974321615fa7" (UID: "e848cbfd-70c8-468a-8fd2-974321615fa7"). InnerVolumeSpecName "kube-api-access-48wqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:14:05.079632 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:05.079544    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48wqk\" (UniqueName: \"kubernetes.io/projected/e848cbfd-70c8-468a-8fd2-974321615fa7-kube-api-access-48wqk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:14:05.795340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:05.795255    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz" event={"ID":"e848cbfd-70c8-468a-8fd2-974321615fa7","Type":"ContainerDied","Data":"68008d2f35a045d558aa3619d3604cbe7259971d7a3bbcc05ccea81433e2e5b6"}
Oct 30 07:14:05.795340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:05.795304    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"
Oct 30 07:14:05.795340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:05.795323    5073 scope.go:122] "RemoveContainer" containerID="3c48acde2dc45b0d7d156f7d9c83fe2e7297bd6d8b59d337cc81b0931e9865d9"
Oct 30 07:14:05.847298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:05.847267    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"]
Oct 30 07:14:05.852618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:05.852591    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a163b2-86748dd464-wlkfz"]
Oct 30 07:14:07.423255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:07.423224    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e848cbfd-70c8-468a-8fd2-974321615fa7" path="/var/lib/kubelet/pods/e848cbfd-70c8-468a-8fd2-974321615fa7/volumes"
Oct 30 07:14:13.927300 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:14:13.926269    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:14:19.390985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:19.390940    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6cm4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:14:19.391615 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:19.391582    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:14:19.458024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:19.457970    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-kt2r2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:14:19.458221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:19.458055    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:14:21.411874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.399522    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"]
Oct 30 07:14:21.411874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.400687    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e848cbfd-70c8-468a-8fd2-974321615fa7" containerName="payload-processing"
Oct 30 07:14:21.411874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.400712    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e848cbfd-70c8-468a-8fd2-974321615fa7" containerName="payload-processing"
Oct 30 07:14:21.411874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.406169    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e848cbfd-70c8-468a-8fd2-974321615fa7" containerName="payload-processing"
Oct 30 07:14:21.423870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.423822    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.440959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.440932    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"]
Oct 30 07:14:21.441785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.441760    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c0e3de-serving-cert\""
Oct 30 07:14:21.524580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.524533    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.524757 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.524672    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.525260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.524945    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.525260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.525123    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94bmk\" (UniqueName: \"kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.629877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.628868    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.629877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.629115    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.629877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.629192    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94bmk\" (UniqueName: \"kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.629877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.629301    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.631458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.631431    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.658873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.646810    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.658873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.647394    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.662092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.659509    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94bmk\" (UniqueName: \"kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk\") pod \"maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:21.743488 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:21.743449    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:22.097742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:22.097667    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"]
Oct 30 07:14:22.098190 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:14:22.098165    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde0c52a_5e72_462b_9339_9a0e791ffb08.slice/crio-688e3877f9379a0d88c122be1f4021413fecfcaed59483ff5144118b6c2d4999 WatchSource:0}: Error finding container 688e3877f9379a0d88c122be1f4021413fecfcaed59483ff5144118b6c2d4999: Status 404 returned error can't find the container with id 688e3877f9379a0d88c122be1f4021413fecfcaed59483ff5144118b6c2d4999
Oct 30 07:14:23.063520 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:23.063480    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt" event={"ID":"cde0c52a-5e72-462b-9339-9a0e791ffb08","Type":"ContainerStarted","Data":"131b6b9f07c98a292afb81036ea428f39e0794f24049603e63781dd63b128dc8"}
Oct 30 07:14:23.063965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:23.063545    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt" event={"ID":"cde0c52a-5e72-462b-9339-9a0e791ffb08","Type":"ContainerStarted","Data":"688e3877f9379a0d88c122be1f4021413fecfcaed59483ff5144118b6c2d4999"}
Oct 30 07:14:23.063965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:23.063629    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:23.109891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:23.109813    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt" podStartSLOduration=1.7310147900000001 podStartE2EDuration="2.109793305s" totalImagesPullingTime="378.778515ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:14:23.106692496 +0000 UTC m=+1065.814572666" watchObservedRunningTime="2026-10-30 07:14:23.109793305 +0000 UTC m=+1065.817673475"
Oct 30 07:14:27.097939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.097904    5073 generic.go:356] "Generic (PLEG): container finished" podID="18598b60-9d3f-40e3-a41c-9a549153358d" containerID="a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9" exitCode=0
Oct 30 07:14:27.098423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.097973    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" event={"ID":"18598b60-9d3f-40e3-a41c-9a549153358d","Type":"ContainerDied","Data":"a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"}
Oct 30 07:14:27.098423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.098416    5073 scope.go:122] "RemoveContainer" containerID="a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"
Oct 30 07:14:27.100182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.100147    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:14:27.100293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.100228    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:14:27.100293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.100266    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:14:27.248274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.248239    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"]
Oct 30 07:14:27.255128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.253909    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.284112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.273960    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a273fd-serving-cert\""
Oct 30 07:14:27.293448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.293418    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"]
Oct 30 07:14:27.342320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.342285    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.342588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.342567    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxktn\" (UniqueName: \"kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.342931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.342909    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.343026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.342965    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.455878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.448264    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxktn\" (UniqueName: \"kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.455878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.448542    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.455878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.448583    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.455878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.448765    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.468987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.462184    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.468987 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:14:27.463083    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-serving-cert: secret "maas-api-e2e-ipp-a-a273fd-serving-cert" not found
Oct 30 07:14:27.468987 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:14:27.463152    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls podName:8c9cb2d7-fe86-4a63-90a4-43c342d5bf37 nodeName:}" failed. No retries permitted until 2026-10-30 07:14:27.963130344 +0000 UTC m=+1070.671010504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls") pod "maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" (UID: "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37") : secret "maas-api-e2e-ipp-a-a273fd-serving-cert" not found
Oct 30 07:14:27.491519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.491482    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxktn\" (UniqueName: \"kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.498830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.497971    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.970037 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.970006    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:27.976430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:27.976395    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:28.110860 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:28.110808    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" event={"ID":"18598b60-9d3f-40e3-a41c-9a549153358d","Type":"ContainerStarted","Data":"ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b"}
Oct 30 07:14:28.199887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:28.196477    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:28.707771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:28.679944    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"]
Oct 30 07:14:28.707771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:28.680349    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:14:28.707771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:28.680455    5073 patch_prober.go:29] interesting pod/e2e-api-b-f357db-openshift-default-777c66bcc-4486p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 07:14:28.707771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:28.680510    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 07:14:29.103320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:29.103290    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:14:29.120290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:29.120260    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" event={"ID":"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37","Type":"ContainerStarted","Data":"56e1bb6cebf300d6ffac9a78f3940fa63c79841cc40356d2bfc908679326ac8d"}
Oct 30 07:14:29.669452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:29.669410    5073 patch_prober.go:29] interesting pod/e2e-api-b-f357db-openshift-default-777c66bcc-4486p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 07:14:29.669612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:29.669473    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 07:14:30.129274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:30.129237    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" event={"ID":"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37","Type":"ContainerStarted","Data":"59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996"}
Oct 30 07:14:30.129709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:30.129341    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:30.170030 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:30.169949    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" podStartSLOduration=2.694321336 podStartE2EDuration="3.169931095s" totalImagesPullingTime="475.609759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:14:30.168803828 +0000 UTC m=+1072.876683998" watchObservedRunningTime="2026-10-30 07:14:30.169931095 +0000 UTC m=+1072.877811285"
Oct 30 07:14:30.669619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:30.669581    5073 patch_prober.go:29] interesting pod/e2e-api-b-f357db-openshift-default-777c66bcc-4486p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 07:14:30.669793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:30.669638    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 07:14:31.669695 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:31.669659    5073 patch_prober.go:29] interesting pod/e2e-api-b-f357db-openshift-default-777c66bcc-4486p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 07:14:31.670130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:31.669710    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 07:14:32.668946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:32.668910    5073 patch_prober.go:29] interesting pod/e2e-api-b-f357db-openshift-default-777c66bcc-4486p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 07:14:32.669125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:32.668977    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 07:14:33.673948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:33.673911    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:14:33.674468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:33.674449    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:14:33.675155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:33.675133    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:14:36.144496 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:36.144461    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:14:36.663372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:36.663317    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"]
Oct 30 07:14:36.663629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:36.663523    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf" podUID="96cdf0e7-164e-4365-bca3-a5f04fef548e" containerName="maas-api" containerID="cri-o://239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2" gracePeriod=30
Oct 30 07:14:37.053552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.053521    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:14:37.187569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.187534    5073 generic.go:356] "Generic (PLEG): container finished" podID="96cdf0e7-164e-4365-bca3-a5f04fef548e" containerID="239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2" exitCode=0
Oct 30 07:14:37.188035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.187604    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"
Oct 30 07:14:37.188035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.187622    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf" event={"ID":"96cdf0e7-164e-4365-bca3-a5f04fef548e","Type":"ContainerDied","Data":"239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2"}
Oct 30 07:14:37.188035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.187692    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf" event={"ID":"96cdf0e7-164e-4365-bca3-a5f04fef548e","Type":"ContainerDied","Data":"99ae34a53dd5f26e3fbfd5dcbb2c22f48b8a2a52a6e263b7070748716baed2ff"}
Oct 30 07:14:37.188035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.187717    5073 scope.go:122] "RemoveContainer" containerID="239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2"
Oct 30 07:14:37.200422 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.200387    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh\" (UniqueName: \"kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh\") pod \"96cdf0e7-164e-4365-bca3-a5f04fef548e\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") "
Oct 30 07:14:37.200601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.200585    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls\") pod \"96cdf0e7-164e-4365-bca3-a5f04fef548e\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") "
Oct 30 07:14:37.200683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.200649    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs\") pod \"96cdf0e7-164e-4365-bca3-a5f04fef548e\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") "
Oct 30 07:14:37.200753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.200687    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca\") pod \"96cdf0e7-164e-4365-bca3-a5f04fef548e\" (UID: \"96cdf0e7-164e-4365-bca3-a5f04fef548e\") "
Oct 30 07:14:37.201829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.201794    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca" pod "96cdf0e7-164e-4365-bca3-a5f04fef548e" (UID: "96cdf0e7-164e-4365-bca3-a5f04fef548e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:14:37.202263 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.202243    5073 scope.go:122] "RemoveContainer" containerID="239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2"
Oct 30 07:14:37.206470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.206445    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh" pod "96cdf0e7-164e-4365-bca3-a5f04fef548e" (UID: "96cdf0e7-164e-4365-bca3-a5f04fef548e"). InnerVolumeSpecName "kube-api-access-9sshh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:14:37.207326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.207301    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs" pod "96cdf0e7-164e-4365-bca3-a5f04fef548e" (UID: "96cdf0e7-164e-4365-bca3-a5f04fef548e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:14:37.208812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.208785    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls" pod "96cdf0e7-164e-4365-bca3-a5f04fef548e" (UID: "96cdf0e7-164e-4365-bca3-a5f04fef548e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:14:37.208963 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:14:37.208913    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2\": container with ID starting with 239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2 not found: ID does not exist" containerID="239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2"
Oct 30 07:14:37.209038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.208951    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2"} err="failed to get container status \"239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2\": rpc error: code = NotFound desc = could not find container \"239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2\": container with ID starting with 239c657cd3d824a60fc5a3c050223172e2ad782e04a63f4f67ba393b8e3dbda2 not found: ID does not exist"
Oct 30 07:14:37.304812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.304774    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sshh\" (UniqueName: \"kubernetes.io/projected/96cdf0e7-164e-4365-bca3-a5f04fef548e-kube-api-access-9sshh\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:14:37.305052 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.304928    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:14:37.305052 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.304949    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96cdf0e7-164e-4365-bca3-a5f04fef548e-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:14:37.305052 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.304962    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96cdf0e7-164e-4365-bca3-a5f04fef548e-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:14:37.528760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.528728    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"]
Oct 30 07:14:37.539842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:37.539805    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6a14e07-84d574ddfc-mjtmf"]
Oct 30 07:14:39.424402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:14:39.424367    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96cdf0e7-164e-4365-bca3-a5f04fef548e" path="/var/lib/kubelet/pods/96cdf0e7-164e-4365-bca3-a5f04fef548e/volumes"
Oct 30 07:14:43.969880 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:14:43.969646    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:15:09.186109 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.186054    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"]
Oct 30 07:15:09.187019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.186983    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995" podUID="ea90628e-f856-4903-be52-0cde15a604e2" containerName="maas-api" containerID="cri-o://3fea136b155736ea3981ce2c64d6b32158344708eb1fb862554757ac5fa841b1" gracePeriod=30
Oct 30 07:15:09.623681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.623647    5073 generic.go:356] "Generic (PLEG): container finished" podID="ea90628e-f856-4903-be52-0cde15a604e2" containerID="3fea136b155736ea3981ce2c64d6b32158344708eb1fb862554757ac5fa841b1" exitCode=0
Oct 30 07:15:09.624165 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.624131    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995" event={"ID":"ea90628e-f856-4903-be52-0cde15a604e2","Type":"ContainerDied","Data":"3fea136b155736ea3981ce2c64d6b32158344708eb1fb862554757ac5fa841b1"}
Oct 30 07:15:09.661476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.661447    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:15:09.664069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.664043    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v\" (UniqueName: \"kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v\") pod \"ea90628e-f856-4903-be52-0cde15a604e2\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") "
Oct 30 07:15:09.664205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.664126    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls\") pod \"ea90628e-f856-4903-be52-0cde15a604e2\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") "
Oct 30 07:15:09.664272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.664199    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca\") pod \"ea90628e-f856-4903-be52-0cde15a604e2\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") "
Oct 30 07:15:09.664329 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.664268    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs\") pod \"ea90628e-f856-4903-be52-0cde15a604e2\" (UID: \"ea90628e-f856-4903-be52-0cde15a604e2\") "
Oct 30 07:15:09.664844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.664816    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca" pod "ea90628e-f856-4903-be52-0cde15a604e2" (UID: "ea90628e-f856-4903-be52-0cde15a604e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:15:09.665316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.665295    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea90628e-f856-4903-be52-0cde15a604e2-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:15:09.667398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.667374    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs" pod "ea90628e-f856-4903-be52-0cde15a604e2" (UID: "ea90628e-f856-4903-be52-0cde15a604e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:15:09.667494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.667470    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls" pod "ea90628e-f856-4903-be52-0cde15a604e2" (UID: "ea90628e-f856-4903-be52-0cde15a604e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:15:09.667541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.667483    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v" pod "ea90628e-f856-4903-be52-0cde15a604e2" (UID: "ea90628e-f856-4903-be52-0cde15a604e2"). InnerVolumeSpecName "kube-api-access-hn47v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:15:09.767931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.767892    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:15:09.767931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.767934    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn47v\" (UniqueName: \"kubernetes.io/projected/ea90628e-f856-4903-be52-0cde15a604e2-kube-api-access-hn47v\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:15:09.768212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:09.767951    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea90628e-f856-4903-be52-0cde15a604e2-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:15:10.633353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:10.633318    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995" event={"ID":"ea90628e-f856-4903-be52-0cde15a604e2","Type":"ContainerDied","Data":"6f4c936b32322d958c78d71036623bd427748d361aa6b93116238847244c5c78"}
Oct 30 07:15:10.633353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:10.633338    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"
Oct 30 07:15:10.633885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:10.633388    5073 scope.go:122] "RemoveContainer" containerID="3fea136b155736ea3981ce2c64d6b32158344708eb1fb862554757ac5fa841b1"
Oct 30 07:15:10.684433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:10.684401    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"]
Oct 30 07:15:10.695705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:10.695672    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3bda71-68b5b8c7f5-n2995"]
Oct 30 07:15:11.423168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:11.423136    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea90628e-f856-4903-be52-0cde15a604e2" path="/var/lib/kubelet/pods/ea90628e-f856-4903-be52-0cde15a604e2/volumes"
Oct 30 07:15:13.923382 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:15:13.923345    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:15:15.971598 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.971560    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"]
Oct 30 07:15:15.972729 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.972702    5073 cpu_manager.go:414] "containerMap: removing container" podUID="96cdf0e7-164e-4365-bca3-a5f04fef548e" containerName="maas-api"
Oct 30 07:15:15.972729 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.972727    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96cdf0e7-164e-4365-bca3-a5f04fef548e" containerName="maas-api"
Oct 30 07:15:15.972945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.972815    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ea90628e-f856-4903-be52-0cde15a604e2" containerName="maas-api"
Oct 30 07:15:15.972945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.972823    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea90628e-f856-4903-be52-0cde15a604e2" containerName="maas-api"
Oct 30 07:15:15.973051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.972991    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea90628e-f856-4903-be52-0cde15a604e2" containerName="maas-api"
Oct 30 07:15:15.973051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.973006    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="96cdf0e7-164e-4365-bca3-a5f04fef548e" containerName="maas-api"
Oct 30 07:15:15.977735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.977713    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:15.997629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:15.997602    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"]
Oct 30 07:15:16.008871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.003939    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a273fd\""
Oct 30 07:15:16.008871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.004599    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a273fd-dockercfg-fwrn5\""
Oct 30 07:15:16.094258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.094213    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.094461 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.094433    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8pdj\" (UniqueName: \"kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj\") pod \"payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.195603 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.195561    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8pdj\" (UniqueName: \"kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj\") pod \"payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.195846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.195825    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.196906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.196879    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.218730 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.218680    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8pdj\" (UniqueName: \"kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj\") pod \"payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.301393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.301307    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:16.650795 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:15:16.650752    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda261456_18ea_441b_b541_29f729790c11.slice/crio-1247f0bfda7ae5cb0970848f07486c367e1e1610928e0d5c486aabd80b986bd9 WatchSource:0}: Error finding container 1247f0bfda7ae5cb0970848f07486c367e1e1610928e0d5c486aabd80b986bd9: Status 404 returned error can't find the container with id 1247f0bfda7ae5cb0970848f07486c367e1e1610928e0d5c486aabd80b986bd9
Oct 30 07:15:16.651603 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.651578    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"]
Oct 30 07:15:16.655469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.655445    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"]
Oct 30 07:15:16.661146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.661125    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.681506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.681472    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s" event={"ID":"da261456-18ea-441b-b541-29f729790c11","Type":"ContainerStarted","Data":"1247f0bfda7ae5cb0970848f07486c367e1e1610928e0d5c486aabd80b986bd9"}
Oct 30 07:15:16.690022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.689997    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"]
Oct 30 07:15:16.753746 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.753714    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4e42c8-serving-cert\""
Oct 30 07:15:16.813845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.813801    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.814053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.813949    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b72n\" (UniqueName: \"kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.814053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.814028    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.814168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.814087    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.915784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.915688    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.915980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.915812    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b72n\" (UniqueName: \"kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.915980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.915881    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.915980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.915952    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.923032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.917637    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.927527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.927452    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.967878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.960147    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b72n\" (UniqueName: \"kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.968935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.968898    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs\") pod \"maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:16.980669 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:16.980379    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:17.318999 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:15:17.318965    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode428cb4e_6247_46fd_9ca0_a959bbf5558b.slice/crio-ff773bc1c8db2d14c98995fd144db2d68b132009630153af3ff742d235c17acf WatchSource:0}: Error finding container ff773bc1c8db2d14c98995fd144db2d68b132009630153af3ff742d235c17acf: Status 404 returned error can't find the container with id ff773bc1c8db2d14c98995fd144db2d68b132009630153af3ff742d235c17acf
Oct 30 07:15:17.320764 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:17.320486    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"]
Oct 30 07:15:17.692491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:17.692418    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr" event={"ID":"e428cb4e-6247-46fd-9ca0-a959bbf5558b","Type":"ContainerStarted","Data":"ff773bc1c8db2d14c98995fd144db2d68b132009630153af3ff742d235c17acf"}
Oct 30 07:15:18.704287 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:18.704250    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr" event={"ID":"e428cb4e-6247-46fd-9ca0-a959bbf5558b","Type":"ContainerStarted","Data":"ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000"}
Oct 30 07:15:18.704722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:18.704341    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:18.706225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:18.706193    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s" event={"ID":"da261456-18ea-441b-b541-29f729790c11","Type":"ContainerStarted","Data":"d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab"}
Oct 30 07:15:18.706338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:18.706318    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:18.752322 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:18.752270    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr" podStartSLOduration=2.430565629 podStartE2EDuration="2.75225637s" totalImagesPullingTime="321.690741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:15:18.748816208 +0000 UTC m=+1121.456696377" watchObservedRunningTime="2026-10-30 07:15:18.75225637 +0000 UTC m=+1121.460136539"
Oct 30 07:15:18.796873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:18.795029    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s" podStartSLOduration=1.89139591 podStartE2EDuration="3.795009878s" totalImagesPullingTime="1.903613968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:15:18.789358263 +0000 UTC m=+1121.497238433" watchObservedRunningTime="2026-10-30 07:15:18.795009878 +0000 UTC m=+1121.502890049"
Oct 30 07:15:24.723328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:24.723295    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:15:29.734226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:15:29.734193    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:15:43.928117 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:15:43.928073    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:16:02.101516 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.101466    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"]
Oct 30 07:16:02.108192 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.108161    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.127189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.127150    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.127468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.127441    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64zl\" (UniqueName: \"kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.127579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.127510    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.127579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.127562    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.127951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.127916    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-092c5c-serving-cert\""
Oct 30 07:16:02.129051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.129013    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"]
Oct 30 07:16:02.228623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.228588    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64zl\" (UniqueName: \"kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.228833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.228642    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.228833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.228665    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.228833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.228765    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.230010 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.229982    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.231896 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.231869    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.232267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.232245    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.254306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.254271    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64zl\" (UniqueName: \"kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl\") pod \"maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.433378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.433345    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:02.761161 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:16:02.761131    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cb9228_2518_47ab_94ab_4864484ff7c8.slice/crio-8f8e0b71ccad1765a28689990cf2d56b72fe3e5d8f4d7176c238aba3d1b8f109 WatchSource:0}: Error finding container 8f8e0b71ccad1765a28689990cf2d56b72fe3e5d8f4d7176c238aba3d1b8f109: Status 404 returned error can't find the container with id 8f8e0b71ccad1765a28689990cf2d56b72fe3e5d8f4d7176c238aba3d1b8f109
Oct 30 07:16:02.762163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:02.762137    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"]
Oct 30 07:16:03.277377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:03.277339    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq" event={"ID":"66cb9228-2518-47ab-94ab-4864484ff7c8","Type":"ContainerStarted","Data":"b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790"}
Oct 30 07:16:03.277844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:03.277395    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq" event={"ID":"66cb9228-2518-47ab-94ab-4864484ff7c8","Type":"ContainerStarted","Data":"8f8e0b71ccad1765a28689990cf2d56b72fe3e5d8f4d7176c238aba3d1b8f109"}
Oct 30 07:16:03.277844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:03.277445    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:03.326557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:03.326496    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq" podStartSLOduration=0.927553412 podStartE2EDuration="1.326479304s" totalImagesPullingTime="398.925892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:16:03.326005875 +0000 UTC m=+1166.033886089" watchObservedRunningTime="2026-10-30 07:16:03.326479304 +0000 UTC m=+1166.034359474"
Oct 30 07:16:08.447640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.447607    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"]
Oct 30 07:16:08.448189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.447840    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw" podUID="05739dba-a179-4358-ad7c-9f006fab47cb" containerName="maas-api" containerID="cri-o://1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a" gracePeriod=30
Oct 30 07:16:08.853770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.853735    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:16:08.951833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.951796    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca\") pod \"05739dba-a179-4358-ad7c-9f006fab47cb\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") "
Oct 30 07:16:08.952048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.951895    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls\") pod \"05739dba-a179-4358-ad7c-9f006fab47cb\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") "
Oct 30 07:16:08.952048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.952019    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4\" (UniqueName: \"kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4\") pod \"05739dba-a179-4358-ad7c-9f006fab47cb\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") "
Oct 30 07:16:08.952230 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.952206    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs\") pod \"05739dba-a179-4358-ad7c-9f006fab47cb\" (UID: \"05739dba-a179-4358-ad7c-9f006fab47cb\") "
Oct 30 07:16:08.952286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.952253    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca" pod "05739dba-a179-4358-ad7c-9f006fab47cb" (UID: "05739dba-a179-4358-ad7c-9f006fab47cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:16:08.952777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.952752    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05739dba-a179-4358-ad7c-9f006fab47cb-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:08.958884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.954344    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4" pod "05739dba-a179-4358-ad7c-9f006fab47cb" (UID: "05739dba-a179-4358-ad7c-9f006fab47cb"). InnerVolumeSpecName "kube-api-access-h6hh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:16:08.958884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.954536    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs" pod "05739dba-a179-4358-ad7c-9f006fab47cb" (UID: "05739dba-a179-4358-ad7c-9f006fab47cb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:16:08.958884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:08.954626    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls" pod "05739dba-a179-4358-ad7c-9f006fab47cb" (UID: "05739dba-a179-4358-ad7c-9f006fab47cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:16:09.054831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.054722    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:09.054831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.054761    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05739dba-a179-4358-ad7c-9f006fab47cb-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:09.054831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.054777    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6hh4\" (UniqueName: \"kubernetes.io/projected/05739dba-a179-4358-ad7c-9f006fab47cb-kube-api-access-h6hh4\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:09.293314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.293281    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:16:09.329625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.329533    5073 generic.go:356] "Generic (PLEG): container finished" podID="05739dba-a179-4358-ad7c-9f006fab47cb" containerID="1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a" exitCode=0
Oct 30 07:16:09.329625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.329585    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"
Oct 30 07:16:09.329885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.329622    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw" event={"ID":"05739dba-a179-4358-ad7c-9f006fab47cb","Type":"ContainerDied","Data":"1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a"}
Oct 30 07:16:09.329885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.329673    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw" event={"ID":"05739dba-a179-4358-ad7c-9f006fab47cb","Type":"ContainerDied","Data":"59c72cbd9f3daaeca62c58251386a349f93219bf0d7fb01dd3c7142be7eadd37"}
Oct 30 07:16:09.329885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.329697    5073 scope.go:122] "RemoveContainer" containerID="1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a"
Oct 30 07:16:09.340697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.340681    5073 scope.go:122] "RemoveContainer" containerID="1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a"
Oct 30 07:16:09.340995 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:16:09.340977    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a\": container with ID starting with 1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a not found: ID does not exist" containerID="1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a"
Oct 30 07:16:09.341049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.341004    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a"} err="failed to get container status \"1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a\": rpc error: code = NotFound desc = could not find container \"1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a\": container with ID starting with 1c5beafad9bfb2c6a0dd4ba64febbfa8f2433e665cf7e985c2819fa565b20d4a not found: ID does not exist"
Oct 30 07:16:09.429542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.429511    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"]
Oct 30 07:16:09.431213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:09.431187    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f357db-5d56d8865f-gsgrw"]
Oct 30 07:16:11.425604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:11.425481    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05739dba-a179-4358-ad7c-9f006fab47cb" path="/var/lib/kubelet/pods/05739dba-a179-4358-ad7c-9f006fab47cb/volumes"
Oct 30 07:16:13.931342 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:16:13.930876    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:16:16.940878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:16.938972    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"]
Oct 30 07:16:16.940878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:16.939213    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" containerID="cri-o://ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b" gracePeriod=30
Oct 30 07:16:18.682074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:18.682022    5073 patch_prober.go:29] interesting pod/e2e-api-b-f357db-openshift-default-777c66bcc-4486p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:16:18.682684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:18.682632    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:16:19.232299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.232265    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"]
Oct 30 07:16:19.233059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.233042    5073 cpu_manager.go:414] "containerMap: removing container" podUID="05739dba-a179-4358-ad7c-9f006fab47cb" containerName="maas-api"
Oct 30 07:16:19.233120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.233060    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05739dba-a179-4358-ad7c-9f006fab47cb" containerName="maas-api"
Oct 30 07:16:19.233180 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.233171    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="05739dba-a179-4358-ad7c-9f006fab47cb" containerName="maas-api"
Oct 30 07:16:19.238367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.238349    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.265212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.265186    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-ba67d8-serving-cert\""
Oct 30 07:16:19.269107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.269078    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"]
Oct 30 07:16:19.290394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.290361    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.290606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.290414    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.290606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.290511    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghng\" (UniqueName: \"kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.290606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.290589    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.392737 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.392696    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.392973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.392749    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.392973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.392842    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghng\" (UniqueName: \"kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.392973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.392936    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.393541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.393512    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.396259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.396231    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.396350 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.396230    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.418498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.418472    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghng\" (UniqueName: \"kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng\") pod \"maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.552678 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.552582    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:19.878268 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:16:19.878234    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b40bea9_3d64_43b5_a9f7_875bf2912bb8.slice/crio-d003221edc86f4dcc90a3c324cbe7d121e830fc922edf280838ebe1528d2fc4f WatchSource:0}: Error finding container d003221edc86f4dcc90a3c324cbe7d121e830fc922edf280838ebe1528d2fc4f: Status 404 returned error can't find the container with id d003221edc86f4dcc90a3c324cbe7d121e830fc922edf280838ebe1528d2fc4f
Oct 30 07:16:19.879888 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:19.879825    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"]
Oct 30 07:16:20.480035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:20.479982    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b" event={"ID":"9b40bea9-3d64-43b5-a9f7-875bf2912bb8","Type":"ContainerStarted","Data":"be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad"}
Oct 30 07:16:20.480214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:20.480061    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b" event={"ID":"9b40bea9-3d64-43b5-a9f7-875bf2912bb8","Type":"ContainerStarted","Data":"d003221edc86f4dcc90a3c324cbe7d121e830fc922edf280838ebe1528d2fc4f"}
Oct 30 07:16:20.480214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:20.480202    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:20.528558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:20.528507    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b" podStartSLOduration=1.128577899 podStartE2EDuration="1.528493463s" totalImagesPullingTime="399.915564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:16:20.525433806 +0000 UTC m=+1183.233313974" watchObservedRunningTime="2026-10-30 07:16:20.528493463 +0000 UTC m=+1183.236373631"
Oct 30 07:16:22.251262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.251235    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:16:22.362195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362158    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362211    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362261    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362331    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362370    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362415    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362540    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:16:22.362671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362582    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362647    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.362909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362668    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:16:22.362909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362803    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket\") pod \"18598b60-9d3f-40e3-a41c-9a549153358d\" (UID: \"18598b60-9d3f-40e3-a41c-9a549153358d\") "
Oct 30 07:16:22.363023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.362912    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:16:22.363373 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363315    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:16:22.363478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363409    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:16:22.363564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363543    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.363629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363570    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.363629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363584    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18598b60-9d3f-40e3-a41c-9a549153358d-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.363629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363599    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.363629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.363611    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.365320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.365284    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:16:22.365622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.365598    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "kube-api-access-dfkfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:16:22.365789 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.365766    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:16:22.366145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.366124    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token" pod "18598b60-9d3f-40e3-a41c-9a549153358d" (UID: "18598b60-9d3f-40e3-a41c-9a549153358d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:16:22.465092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.465063    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18598b60-9d3f-40e3-a41c-9a549153358d-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.465092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.465087    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.465092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.465096    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkfz\" (UniqueName: \"kubernetes.io/projected/18598b60-9d3f-40e3-a41c-9a549153358d-kube-api-access-dfkfz\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.465323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.465107    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18598b60-9d3f-40e3-a41c-9a549153358d-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:22.504869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.504760    5073 generic.go:356] "Generic (PLEG): container finished" podID="18598b60-9d3f-40e3-a41c-9a549153358d" containerID="ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b" exitCode=0
Oct 30 07:16:22.504869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.504816    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"
Oct 30 07:16:22.505088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.504862    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" event={"ID":"18598b60-9d3f-40e3-a41c-9a549153358d","Type":"ContainerDied","Data":"ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b"}
Oct 30 07:16:22.505088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.504924    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p" event={"ID":"18598b60-9d3f-40e3-a41c-9a549153358d","Type":"ContainerDied","Data":"a57d63d6420a05642c1952ac730b625876e8d4845541a96cd3ad8cca15ea5ab4"}
Oct 30 07:16:22.505088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.504952    5073 scope.go:122] "RemoveContainer" containerID="ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b"
Oct 30 07:16:22.518251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.518225    5073 scope.go:122] "RemoveContainer" containerID="a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"
Oct 30 07:16:22.528458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.528435    5073 scope.go:122] "RemoveContainer" containerID="ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b"
Oct 30 07:16:22.528755 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:16:22.528731    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b\": container with ID starting with ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b not found: ID does not exist" containerID="ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b"
Oct 30 07:16:22.528801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.528765    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b"} err="failed to get container status \"ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b\": rpc error: code = NotFound desc = could not find container \"ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b\": container with ID starting with ac697d24bb3f80c1dffe60361049d2d5b9d6b4a1462860e10e5b1ca65178565b not found: ID does not exist"
Oct 30 07:16:22.528801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.528781    5073 scope.go:122] "RemoveContainer" containerID="a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"
Oct 30 07:16:22.529046 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:16:22.529024    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9\": container with ID starting with a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9 not found: ID does not exist" containerID="a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"
Oct 30 07:16:22.529084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.529055    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9"} err="failed to get container status \"a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9\": rpc error: code = NotFound desc = could not find container \"a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9\": container with ID starting with a963a21061a5f1d79188e2b03c208c0182d864037ddf7e500db7088bb32f80d9 not found: ID does not exist"
Oct 30 07:16:22.556992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.556962    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"]
Oct 30 07:16:22.563886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:22.561433    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f357db-openshift-default-777c66bcc-4486p"]
Oct 30 07:16:23.427134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:23.427100    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" path="/var/lib/kubelet/pods/18598b60-9d3f-40e3-a41c-9a549153358d/volumes"
Oct 30 07:16:26.528475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:26.528448    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:16:37.799956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:37.799920    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:16:37.806514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:37.806489    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:16:40.278242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.278201    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"]
Oct 30 07:16:40.278757 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.278422    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt" podUID="cde0c52a-5e72-462b-9339-9a0e791ffb08" containerName="maas-api" containerID="cri-o://131b6b9f07c98a292afb81036ea428f39e0794f24049603e63781dd63b128dc8" gracePeriod=30
Oct 30 07:16:40.669455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.669248    5073 generic.go:356] "Generic (PLEG): container finished" podID="cde0c52a-5e72-462b-9339-9a0e791ffb08" containerID="131b6b9f07c98a292afb81036ea428f39e0794f24049603e63781dd63b128dc8" exitCode=0
Oct 30 07:16:40.670062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.669934    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt" event={"ID":"cde0c52a-5e72-462b-9339-9a0e791ffb08","Type":"ContainerDied","Data":"131b6b9f07c98a292afb81036ea428f39e0794f24049603e63781dd63b128dc8"}
Oct 30 07:16:40.670062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.670004    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt" event={"ID":"cde0c52a-5e72-462b-9339-9a0e791ffb08","Type":"ContainerDied","Data":"688e3877f9379a0d88c122be1f4021413fecfcaed59483ff5144118b6c2d4999"}
Oct 30 07:16:40.670062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.670029    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="688e3877f9379a0d88c122be1f4021413fecfcaed59483ff5144118b6c2d4999"
Oct 30 07:16:40.687827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.687798    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:16:40.768766 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.768721    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs\") pod \"cde0c52a-5e72-462b-9339-9a0e791ffb08\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") "
Oct 30 07:16:40.768993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.768842    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls\") pod \"cde0c52a-5e72-462b-9339-9a0e791ffb08\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") "
Oct 30 07:16:40.768993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.768967    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk\" (UniqueName: \"kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk\") pod \"cde0c52a-5e72-462b-9339-9a0e791ffb08\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") "
Oct 30 07:16:40.769127 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.769011    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca\") pod \"cde0c52a-5e72-462b-9339-9a0e791ffb08\" (UID: \"cde0c52a-5e72-462b-9339-9a0e791ffb08\") "
Oct 30 07:16:40.769586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.769558    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca" pod "cde0c52a-5e72-462b-9339-9a0e791ffb08" (UID: "cde0c52a-5e72-462b-9339-9a0e791ffb08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:16:40.774741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.769838    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cde0c52a-5e72-462b-9339-9a0e791ffb08-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:40.774741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.772403    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk" pod "cde0c52a-5e72-462b-9339-9a0e791ffb08" (UID: "cde0c52a-5e72-462b-9339-9a0e791ffb08"). InnerVolumeSpecName "kube-api-access-94bmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:16:40.776264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.776229    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls" pod "cde0c52a-5e72-462b-9339-9a0e791ffb08" (UID: "cde0c52a-5e72-462b-9339-9a0e791ffb08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:16:40.776384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.776309    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs" pod "cde0c52a-5e72-462b-9339-9a0e791ffb08" (UID: "cde0c52a-5e72-462b-9339-9a0e791ffb08"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:16:40.872991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.872908    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:40.872991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.872938    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cde0c52a-5e72-462b-9339-9a0e791ffb08-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:40.872991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:40.872951    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94bmk\" (UniqueName: \"kubernetes.io/projected/cde0c52a-5e72-462b-9339-9a0e791ffb08-kube-api-access-94bmk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:16:41.677894 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:41.677816    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"
Oct 30 07:16:41.731948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:41.731916    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"]
Oct 30 07:16:41.740383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:41.740344    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0e3de-7b6d7f6f-gh8xt"]
Oct 30 07:16:43.494913 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:43.444603    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cde0c52a-5e72-462b-9339-9a0e791ffb08" path="/var/lib/kubelet/pods/cde0c52a-5e72-462b-9339-9a0e791ffb08/volumes"
Oct 30 07:16:43.924073 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:16:43.924033    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:16:44.003585 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.003547    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"]
Oct 30 07:16:44.004771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.004737    5073 cpu_manager.go:414] "containerMap: removing container" podUID="cde0c52a-5e72-462b-9339-9a0e791ffb08" containerName="maas-api"
Oct 30 07:16:44.004771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.004764    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cde0c52a-5e72-462b-9339-9a0e791ffb08" containerName="maas-api"
Oct 30 07:16:44.005020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.004800    5073 cpu_manager.go:414] "containerMap: removing container" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy"
Oct 30 07:16:44.005020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.004808    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy"
Oct 30 07:16:44.005020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.004844    5073 cpu_manager.go:414] "containerMap: removing container" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy"
Oct 30 07:16:44.005020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.004869    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy"
Oct 30 07:16:44.005238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.005068    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="cde0c52a-5e72-462b-9339-9a0e791ffb08" containerName="maas-api"
Oct 30 07:16:44.005238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.005084    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy"
Oct 30 07:16:44.005238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.005099    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="18598b60-9d3f-40e3-a41c-9a549153358d" containerName="istio-proxy"
Oct 30 07:16:44.010751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.010730    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.026228 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.026204    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-137ec6-serving-cert\""
Oct 30 07:16:44.031647 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.031620    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"]
Oct 30 07:16:44.131906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.131842    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.132085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.132047    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.132140 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.132082    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmxm\" (UniqueName: \"kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.132212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.132195    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.240066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.239965    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.240231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.240155    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.240325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.240308    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.240378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.240346    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmxm\" (UniqueName: \"kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.242312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.242271    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.244935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.244911    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.253733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.253702    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.264091 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.264063    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmxm\" (UniqueName: \"kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm\") pod \"maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.329214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.329134    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:44.661484 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:16:44.658570    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23571a3_b4cf_4333_96ca_fe822f0aad74.slice/crio-0c8e0f729954a6cf10c06515a62960bf9e7ed4d741ad481f710ad50d4714b62e WatchSource:0}: Error finding container 0c8e0f729954a6cf10c06515a62960bf9e7ed4d741ad481f710ad50d4714b62e: Status 404 returned error can't find the container with id 0c8e0f729954a6cf10c06515a62960bf9e7ed4d741ad481f710ad50d4714b62e
Oct 30 07:16:44.661484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.659363    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"]
Oct 30 07:16:44.704415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:44.704378    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w" event={"ID":"b23571a3-b4cf-4333-96ca-fe822f0aad74","Type":"ContainerStarted","Data":"0c8e0f729954a6cf10c06515a62960bf9e7ed4d741ad481f710ad50d4714b62e"}
Oct 30 07:16:45.728551 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:45.728509    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w" event={"ID":"b23571a3-b4cf-4333-96ca-fe822f0aad74","Type":"ContainerStarted","Data":"4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8"}
Oct 30 07:16:45.732079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:45.728607    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:45.771745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:45.771696    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w" podStartSLOduration=2.411174368 podStartE2EDuration="2.771682612s" totalImagesPullingTime="360.508244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:16:45.768378992 +0000 UTC m=+1208.476259158" watchObservedRunningTime="2026-10-30 07:16:45.771682612 +0000 UTC m=+1208.479562780"
Oct 30 07:16:51.742239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:51.742160    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:16:54.049552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.049507    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"]
Oct 30 07:16:54.054202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.054184    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.071385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.071356    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ba67d8-openshift-default-dockercfg-r2cwg\""
Oct 30 07:16:54.087391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.087363    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"]
Oct 30 07:16:54.221340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221296    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221359    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221497    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221537    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221653    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221729    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221764    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.221914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.221896    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.222015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.222001    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9kr\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323435    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323490    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323573    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323613    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323669    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323722    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323755    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323817    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.323999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.323940    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9kr\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.324174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.324148    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.324461 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.324437    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.324572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.324520    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.324572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.324557    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.324687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.324675    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.326464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.326442    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.326642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.326625    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.345509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.345481    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.345639 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.345619    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9kr\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr\") pod \"e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") " pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.373654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.373630    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:54.704431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.704400    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"]
Oct 30 07:16:54.704551 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:16:54.704433    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d0c198_1615_4458_86c5_df9749fa8b4a.slice/crio-c70f582f02636c1f17a20e096d6c01da0dff88e4caaf338f801d036f8da67c67 WatchSource:0}: Error finding container c70f582f02636c1f17a20e096d6c01da0dff88e4caaf338f801d036f8da67c67: Status 404 returned error can't find the container with id c70f582f02636c1f17a20e096d6c01da0dff88e4caaf338f801d036f8da67c67
Oct 30 07:16:54.707984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.707947    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:16:54.708098 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.708025    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:16:54.708098 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.708066    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:16:54.808419 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.808373    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" event={"ID":"75d0c198-1615-4458-86c5-df9749fa8b4a","Type":"ContainerStarted","Data":"2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2"}
Oct 30 07:16:54.808600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.808480    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" event={"ID":"75d0c198-1615-4458-86c5-df9749fa8b4a","Type":"ContainerStarted","Data":"c70f582f02636c1f17a20e096d6c01da0dff88e4caaf338f801d036f8da67c67"}
Oct 30 07:16:54.859050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:54.858998    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podStartSLOduration=0.858985378 podStartE2EDuration="858.985378ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:16:54.855729376 +0000 UTC m=+1217.563609545" watchObservedRunningTime="2026-10-30 07:16:54.858985378 +0000 UTC m=+1217.566865547"
Oct 30 07:16:55.386875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:55.383270    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:16:55.391360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:55.391318    5073 patch_prober.go:29] interesting pod/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 07:16:55.391623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:55.391595    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 07:16:56.392876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:56.392315    5073 patch_prober.go:29] interesting pod/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 07:16:56.392876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:56.392392    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 07:16:57.387876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:57.377169    5073 patch_prober.go:29] interesting pod/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 07:16:57.387876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:57.377227    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 07:16:58.396905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:58.395950    5073 patch_prober.go:29] interesting pod/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 07:16:58.396905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:58.396044    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 07:16:59.376178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:59.376139    5073 patch_prober.go:29] interesting pod/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 07:16:59.376457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:16:59.376428    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 07:17:00.379876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:00.375158    5073 patch_prober.go:29] interesting pod/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 07:17:00.379876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:00.375231    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 07:17:01.380701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:01.380666    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:17:01.383983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:01.383948    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:17:01.384955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:01.384931    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:17:13.923463 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:17:13.923423    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:17:16.590739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:16.590707    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-8r9sh_040eb592-bd9f-4293-9525-703635e87f32/payload-processing/0.log"
Oct 30 07:17:16.807459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:16.807428    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-8r9sh_040eb592-bd9f-4293-9525-703635e87f32/payload-processing/0.log"
Oct 30 07:17:25.583195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:25.583150    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"]
Oct 30 07:17:25.583789 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:25.583407    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy" containerID="cri-o://a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045" gracePeriod=30
Oct 30 07:17:30.892669 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.892642    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:17:30.907209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907182    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907281    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907342    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907360    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907433    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907468    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:17:30.907582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907517    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907559    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907632    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907680    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:17:30.907777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907704    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p\") pod \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\" (UID: \"849ad3e0-1adf-4b9f-a141-46bebaafc5dc\") "
Oct 30 07:17:30.907777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907746    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:17:30.908005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.907980    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:17:30.908338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.908307    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:17:30.908508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.908403    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:30.908508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.908425    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:30.908508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.908439    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:30.908508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.908452    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:30.909958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.909932    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "kube-api-access-hvp6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:17:30.910297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.910276    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:17:30.910454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.910433    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:17:30.910515 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:30.910442    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy" pod "849ad3e0-1adf-4b9f-a141-46bebaafc5dc" (UID: "849ad3e0-1adf-4b9f-a141-46bebaafc5dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:17:31.010882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.010756    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:31.010882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.010794    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:31.010882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.010807    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:31.010882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.010820    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:31.010882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.010833    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvp6p\" (UniqueName: \"kubernetes.io/projected/849ad3e0-1adf-4b9f-a141-46bebaafc5dc-kube-api-access-hvp6p\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:31.318844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.318804    5073 generic.go:356] "Generic (PLEG): container finished" podID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerID="a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045" exitCode=0
Oct 30 07:17:31.319028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.318870    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"
Oct 30 07:17:31.319028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.318895    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" event={"ID":"849ad3e0-1adf-4b9f-a141-46bebaafc5dc","Type":"ContainerDied","Data":"a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045"}
Oct 30 07:17:31.319028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.318947    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp" event={"ID":"849ad3e0-1adf-4b9f-a141-46bebaafc5dc","Type":"ContainerDied","Data":"ca6058b24c965df604ee70cba2fce69ddbde7d0d27db1e612485198adafa0449"}
Oct 30 07:17:31.319028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.318980    5073 scope.go:122] "RemoveContainer" containerID="a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045"
Oct 30 07:17:31.331258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.331239    5073 scope.go:122] "RemoveContainer" containerID="a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045"
Oct 30 07:17:31.331574 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:17:31.331553    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045\": container with ID starting with a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045 not found: ID does not exist" containerID="a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045"
Oct 30 07:17:31.331639 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.331582    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045"} err="failed to get container status \"a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045\": rpc error: code = NotFound desc = could not find container \"a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045\": container with ID starting with a621356f0f32901cf7e15899dc2a1cd3c9d0fba4eea951b2094173af4b1c6045 not found: ID does not exist"
Oct 30 07:17:31.373488 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.373457    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"]
Oct 30 07:17:31.377605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.377581    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-hzlwp"]
Oct 30 07:17:31.424341 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:31.424309    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" path="/var/lib/kubelet/pods/849ad3e0-1adf-4b9f-a141-46bebaafc5dc/volumes"
Oct 30 07:17:44.067159 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:17:44.067091    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:17:51.719512 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:51.719475    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"]
Oct 30 07:17:51.720008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:51.719758    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr" podUID="e428cb4e-6247-46fd-9ca0-a959bbf5558b" containerName="maas-api" containerID="cri-o://ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000" gracePeriod=30
Oct 30 07:17:52.391471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.391438    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:17:52.575877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.565765    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n\" (UniqueName: \"kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n\") pod \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") "
Oct 30 07:17:52.587887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.577378    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls\") pod \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") "
Oct 30 07:17:52.587887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.577485    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs\") pod \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") "
Oct 30 07:17:52.587887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.577555    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca\") pod \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\" (UID: \"e428cb4e-6247-46fd-9ca0-a959bbf5558b\") "
Oct 30 07:17:52.587887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.581199    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n" pod "e428cb4e-6247-46fd-9ca0-a959bbf5558b" (UID: "e428cb4e-6247-46fd-9ca0-a959bbf5558b"). InnerVolumeSpecName "kube-api-access-6b72n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:17:52.596932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.589265    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b72n\" (UniqueName: \"kubernetes.io/projected/e428cb4e-6247-46fd-9ca0-a959bbf5558b-kube-api-access-6b72n\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:52.597358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.597301    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca" pod "e428cb4e-6247-46fd-9ca0-a959bbf5558b" (UID: "e428cb4e-6247-46fd-9ca0-a959bbf5558b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:17:52.609991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.609954    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs" pod "e428cb4e-6247-46fd-9ca0-a959bbf5558b" (UID: "e428cb4e-6247-46fd-9ca0-a959bbf5558b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:17:52.613981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.613948    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls" pod "e428cb4e-6247-46fd-9ca0-a959bbf5558b" (UID: "e428cb4e-6247-46fd-9ca0-a959bbf5558b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:17:52.630990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.630952    5073 generic.go:356] "Generic (PLEG): container finished" podID="e428cb4e-6247-46fd-9ca0-a959bbf5558b" containerID="ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000" exitCode=0
Oct 30 07:17:52.634259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.631060    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"
Oct 30 07:17:52.634906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.631080    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr" event={"ID":"e428cb4e-6247-46fd-9ca0-a959bbf5558b","Type":"ContainerDied","Data":"ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000"}
Oct 30 07:17:52.635188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.635163    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr" event={"ID":"e428cb4e-6247-46fd-9ca0-a959bbf5558b","Type":"ContainerDied","Data":"ff773bc1c8db2d14c98995fd144db2d68b132009630153af3ff742d235c17acf"}
Oct 30 07:17:52.635581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.635530    5073 scope.go:122] "RemoveContainer" containerID="ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000"
Oct 30 07:17:52.650114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.650089    5073 scope.go:122] "RemoveContainer" containerID="ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000"
Oct 30 07:17:52.650497 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:17:52.650473    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000\": container with ID starting with ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000 not found: ID does not exist" containerID="ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000"
Oct 30 07:17:52.650550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.650507    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000"} err="failed to get container status \"ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000\": rpc error: code = NotFound desc = could not find container \"ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000\": container with ID starting with ef882480962e84926b8488b3bc099e60e61163f8ab67021e76f19f1ae8e1d000 not found: ID does not exist"
Oct 30 07:17:52.686401 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.686366    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"]
Oct 30 07:17:52.690955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.690923    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:52.690955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.690951    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e428cb4e-6247-46fd-9ca0-a959bbf5558b-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:52.691152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.690963    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428cb4e-6247-46fd-9ca0-a959bbf5558b-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:17:52.694592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:52.694561    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4e42c8-596c6b69dd-54btr"]
Oct 30 07:17:53.428464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:53.428431    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e428cb4e-6247-46fd-9ca0-a959bbf5558b" path="/var/lib/kubelet/pods/e428cb4e-6247-46fd-9ca0-a959bbf5558b/volumes"
Oct 30 07:17:55.038977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.038934    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"]
Oct 30 07:17:55.039710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.039688    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e428cb4e-6247-46fd-9ca0-a959bbf5558b" containerName="maas-api"
Oct 30 07:17:55.039710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.039707    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e428cb4e-6247-46fd-9ca0-a959bbf5558b" containerName="maas-api"
Oct 30 07:17:55.039887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.039724    5073 cpu_manager.go:414] "containerMap: removing container" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy"
Oct 30 07:17:55.039887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.039730    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy"
Oct 30 07:17:55.039887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.039836    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e428cb4e-6247-46fd-9ca0-a959bbf5558b" containerName="maas-api"
Oct 30 07:17:55.039887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.039846    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="849ad3e0-1adf-4b9f-a141-46bebaafc5dc" containerName="istio-proxy"
Oct 30 07:17:55.043614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.043594    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.088710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.088545    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"]
Oct 30 07:17:55.131116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.131060    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.131333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.131311    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cblxk\" (UniqueName: \"kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.131444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.131366    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.131501 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.131476    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.141700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.141672    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-c1f203-serving-cert\""
Oct 30 07:17:55.233299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.233256    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.233466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.233443    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cblxk\" (UniqueName: \"kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.233540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.233493    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.233597 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.233547    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.240081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.235573    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.240081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.238528    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.254832 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.254526    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.270020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.269993    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cblxk\" (UniqueName: \"kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk\") pod \"maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.362187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.362097    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:55.905103 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:17:55.905072    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8c7b5f_9493_4541_85fe_09ff487ff2f0.slice/crio-48352a36e199d6907c5457f18fe7756caa28344e404d511cf2e819871ab2ce81 WatchSource:0}: Error finding container 48352a36e199d6907c5457f18fe7756caa28344e404d511cf2e819871ab2ce81: Status 404 returned error can't find the container with id 48352a36e199d6907c5457f18fe7756caa28344e404d511cf2e819871ab2ce81
Oct 30 07:17:55.906510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.906488    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:17:55.907886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:55.907838    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"]
Oct 30 07:17:56.718224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:56.718182    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w" event={"ID":"fa8c7b5f-9493-4541-85fe-09ff487ff2f0","Type":"ContainerStarted","Data":"47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf"}
Oct 30 07:17:56.718692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:56.718249    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w" event={"ID":"fa8c7b5f-9493-4541-85fe-09ff487ff2f0","Type":"ContainerStarted","Data":"48352a36e199d6907c5457f18fe7756caa28344e404d511cf2e819871ab2ce81"}
Oct 30 07:17:56.718692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:56.718298    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:17:56.764055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:56.764003    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w" podStartSLOduration=1.392105068 podStartE2EDuration="1.763990395s" totalImagesPullingTime="371.885327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:17:56.76338376 +0000 UTC m=+1279.471263932" watchObservedRunningTime="2026-10-30 07:17:56.763990395 +0000 UTC m=+1279.471870592"
Oct 30 07:17:59.428777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.428746    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"]
Oct 30 07:17:59.429201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.428933    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy" containerID="cri-o://e8b5d76cd358af2be12bf7bf27f2245ba9abb7984cea274e12efc3297ea0a546" gracePeriod=30
Oct 30 07:17:59.455481 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.455444    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"]
Oct 30 07:17:59.456160 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.456122    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" containerID="cri-o://df85132a4a54856c2e7b232e8a2c4c54ce2c20cf7d330a2a8247205dca6dddbd" gracePeriod=30
Oct 30 07:17:59.460393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.460356    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"]
Oct 30 07:17:59.460605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.460572    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy" containerID="cri-o://1ac807844825aacb6e8ac790b3a9769c9ad78c878bec89daf44d4e90830159d5" gracePeriod=30
Oct 30 07:17:59.471607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.464128    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"]
Oct 30 07:17:59.471607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:17:59.464331    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy" containerID="cri-o://521db7857e72015dd44d387539e12b723961359dcd2d4b388ce5b405a6d8eaf3" gracePeriod=30
Oct 30 07:18:02.735871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:02.735829    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:18:04.797832 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.797782    5073 generic.go:356] "Generic (PLEG): container finished" podID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerID="1ac807844825aacb6e8ac790b3a9769c9ad78c878bec89daf44d4e90830159d5" exitCode=0
Oct 30 07:18:04.798273 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.797921    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" event={"ID":"76c55e8e-e138-4db7-8bda-27b4f0eb620b","Type":"ContainerDied","Data":"1ac807844825aacb6e8ac790b3a9769c9ad78c878bec89daf44d4e90830159d5"}
Oct 30 07:18:04.800145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.800117    5073 generic.go:356] "Generic (PLEG): container finished" podID="74015b23-decf-4839-b672-4c32b596c6cf" containerID="521db7857e72015dd44d387539e12b723961359dcd2d4b388ce5b405a6d8eaf3" exitCode=0
Oct 30 07:18:04.800270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.800252    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" event={"ID":"74015b23-decf-4839-b672-4c32b596c6cf","Type":"ContainerDied","Data":"521db7857e72015dd44d387539e12b723961359dcd2d4b388ce5b405a6d8eaf3"}
Oct 30 07:18:04.802542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.802515    5073 generic.go:356] "Generic (PLEG): container finished" podID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerID="e8b5d76cd358af2be12bf7bf27f2245ba9abb7984cea274e12efc3297ea0a546" exitCode=0
Oct 30 07:18:04.802823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.802695    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" event={"ID":"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6","Type":"ContainerDied","Data":"e8b5d76cd358af2be12bf7bf27f2245ba9abb7984cea274e12efc3297ea0a546"}
Oct 30 07:18:04.805086 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.805060    5073 generic.go:356] "Generic (PLEG): container finished" podID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerID="df85132a4a54856c2e7b232e8a2c4c54ce2c20cf7d330a2a8247205dca6dddbd" exitCode=0
Oct 30 07:18:04.805182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.805101    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" event={"ID":"ffa7bd5e-abe0-4359-9b61-8046932572b7","Type":"ContainerDied","Data":"df85132a4a54856c2e7b232e8a2c4c54ce2c20cf7d330a2a8247205dca6dddbd"}
Oct 30 07:18:04.830825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.830795    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:18:04.898153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.898110    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.972895    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.973834    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.973893    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.973927    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.973965    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974018    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974060    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974095    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974159    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974267    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974291    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974321    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974347    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974428    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974457    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974518    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974636    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974674    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs\") pod \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\" (UID: \"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974724    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data\") pod \"ffa7bd5e-abe0-4359-9b61-8046932572b7\" (UID: \"ffa7bd5e-abe0-4359-9b61-8046932572b7\") "
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974514    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.974725    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.975016    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.975111    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.975469    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.975821    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.976095    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.976278    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.976285    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.976318    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.979439    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.979635    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.979811    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.979935    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf" pod "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" (UID: "ad1c830b-dcbc-40fe-a682-74ed9edb8cd6"). InnerVolumeSpecName "kube-api-access-m6wqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.980110    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.980590    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:18:04.980921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.980821    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "kube-api-access-8d8b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:04.982143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.981494    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token" pod "ffa7bd5e-abe0-4359-9b61-8046932572b7" (UID: "ffa7bd5e-abe0-4359-9b61-8046932572b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:04.984354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:04.984325    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078347    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078415    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078460    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078486    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078535    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078584    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078664    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078704    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078733    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.078907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.078763    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.080411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.080215    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.080760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.080566    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.082253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.081315    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.082253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.082220    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.082557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.082477    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.082557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.082535    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.082831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.082814    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.083283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.083264    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.083751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.083733    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.083926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.083906    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.084153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.084134    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.084333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.084316    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket\") pod \"74015b23-decf-4839-b672-4c32b596c6cf\" (UID: \"74015b23-decf-4839-b672-4c32b596c6cf\") "
Oct 30 07:18:05.085653 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.085634    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.085826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.085809    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token\") pod \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\" (UID: \"76c55e8e-e138-4db7-8bda-27b4f0eb620b\") "
Oct 30 07:18:05.086633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.083667    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.086633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.085293    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:18:05.086633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.085527    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.086633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.086429    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:18:05.088609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.088586    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.088743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.088729    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74015b23-decf-4839-b672-4c32b596c6cf-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.088841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.088828    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.088963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.088949    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffa7bd5e-abe0-4359-9b61-8046932572b7-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.089077 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089043    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.089206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089192    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.089474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089048    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:18:05.089474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089420    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:18:05.089474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089463    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "kube-api-access-6bpn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:05.089725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089710    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.089929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.089912    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090102 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090086    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090197    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090289    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090390 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090378    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090472    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090557    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090640    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090730    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090811    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.090985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.090959    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091076    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091246    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091371 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091357    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091472 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091457    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d8b7\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-kube-api-access-8d8b7\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091555    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091662 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091651    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091749 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091737    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6wqf\" (UniqueName: \"kubernetes.io/projected/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-kube-api-access-m6wqf\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.091834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.091822    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa7bd5e-abe0-4359-9b61-8046932572b7-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.092046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.092030    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.092431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.092412    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.092431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.092190    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.092589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.092263    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:18:05.092589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.092317    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:05.092589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.092376    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj" pod "74015b23-decf-4839-b672-4c32b596c6cf" (UID: "74015b23-decf-4839-b672-4c32b596c6cf"). InnerVolumeSpecName "kube-api-access-gx4mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:05.093781 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.093745    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token" pod "76c55e8e-e138-4db7-8bda-27b4f0eb620b" (UID: "76c55e8e-e138-4db7-8bda-27b4f0eb620b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208624    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208662    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208680    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bpn9\" (UniqueName: \"kubernetes.io/projected/76c55e8e-e138-4db7-8bda-27b4f0eb620b-kube-api-access-6bpn9\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208696    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208709    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74015b23-decf-4839-b672-4c32b596c6cf-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208721    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx4mj\" (UniqueName: \"kubernetes.io/projected/74015b23-decf-4839-b672-4c32b596c6cf-kube-api-access-gx4mj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208737    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c55e8e-e138-4db7-8bda-27b4f0eb620b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.213914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.208750    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74015b23-decf-4839-b672-4c32b596c6cf-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:18:05.816742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.816658    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"
Oct 30 07:18:05.816742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.816699    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" event={"ID":"ffa7bd5e-abe0-4359-9b61-8046932572b7","Type":"ContainerDied","Data":"4746fac09038dad7c6c54246264e5ff3fa513eb2d5e61183a90773ecaf9185de"}
Oct 30 07:18:05.817305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.816773    5073 scope.go:122] "RemoveContainer" containerID="df85132a4a54856c2e7b232e8a2c4c54ce2c20cf7d330a2a8247205dca6dddbd"
Oct 30 07:18:05.818691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.818671    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"
Oct 30 07:18:05.818807 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.818673    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq" event={"ID":"76c55e8e-e138-4db7-8bda-27b4f0eb620b","Type":"ContainerDied","Data":"f3d807f2d22c8c6c04b0fb45931c19b2720f2463e2778b06e7e45a2fe23f8917"}
Oct 30 07:18:05.820652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.820633    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"
Oct 30 07:18:05.820755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.820688    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk" event={"ID":"74015b23-decf-4839-b672-4c32b596c6cf","Type":"ContainerDied","Data":"54aeb561dec083dc9cd9feeb92542a3be4a12aa00fbd1ce53b96c5b115dcfa3b"}
Oct 30 07:18:05.822904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.822466    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"
Oct 30 07:18:05.822904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.822471    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk" event={"ID":"ad1c830b-dcbc-40fe-a682-74ed9edb8cd6","Type":"ContainerDied","Data":"7fae0e5c587d6bb8c3998dce270dd02ad94c7672fe7f22d93f4cd2498a2ceec5"}
Oct 30 07:18:05.830057 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.830041    5073 scope.go:122] "RemoveContainer" containerID="1ac807844825aacb6e8ac790b3a9769c9ad78c878bec89daf44d4e90830159d5"
Oct 30 07:18:05.839447 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.839428    5073 scope.go:122] "RemoveContainer" containerID="521db7857e72015dd44d387539e12b723961359dcd2d4b388ce5b405a6d8eaf3"
Oct 30 07:18:05.848034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.848017    5073 scope.go:122] "RemoveContainer" containerID="e8b5d76cd358af2be12bf7bf27f2245ba9abb7984cea274e12efc3297ea0a546"
Oct 30 07:18:05.884806 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.884776    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"]
Oct 30 07:18:05.889732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.889710    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:18:05.889887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.889795    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:18:05.894098 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.894076    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-5ghzk"]
Oct 30 07:18:05.919903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.919882    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"]
Oct 30 07:18:05.923645 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.923623    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-9zwkk"]
Oct 30 07:18:05.959640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.959611    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"]
Oct 30 07:18:05.964726 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.964704    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-76prk"]
Oct 30 07:18:05.995618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:05.995588    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"]
Oct 30 07:18:06.001157 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:06.001130    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-d5hlq"]
Oct 30 07:18:07.454264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:07.453969    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74015b23-decf-4839-b672-4c32b596c6cf" path="/var/lib/kubelet/pods/74015b23-decf-4839-b672-4c32b596c6cf/volumes"
Oct 30 07:18:07.455251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:07.454669    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" path="/var/lib/kubelet/pods/76c55e8e-e138-4db7-8bda-27b4f0eb620b/volumes"
Oct 30 07:18:07.456808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:07.456777    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" path="/var/lib/kubelet/pods/ad1c830b-dcbc-40fe-a682-74ed9edb8cd6/volumes"
Oct 30 07:18:07.457441 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:07.457420    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" path="/var/lib/kubelet/pods/ffa7bd5e-abe0-4359-9b61-8046932572b7/volumes"
Oct 30 07:18:13.923696 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:18:13.923653    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:18:20.111155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111066    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"]
Oct 30 07:18:20.111816 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111796    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy"
Oct 30 07:18:20.111816 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111815    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy"
Oct 30 07:18:20.111973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111847    5073 cpu_manager.go:414] "containerMap: removing container" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy"
Oct 30 07:18:20.111973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111868    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy"
Oct 30 07:18:20.111973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111878    5073 cpu_manager.go:414] "containerMap: removing container" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy"
Oct 30 07:18:20.111973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111886    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy"
Oct 30 07:18:20.111973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111914    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy"
Oct 30 07:18:20.111973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.111922    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy"
Oct 30 07:18:20.112155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.112048    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="76c55e8e-e138-4db7-8bda-27b4f0eb620b" containerName="istio-proxy"
Oct 30 07:18:20.112155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.112072    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="74015b23-decf-4839-b672-4c32b596c6cf" containerName="istio-proxy"
Oct 30 07:18:20.112155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.112080    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad1c830b-dcbc-40fe-a682-74ed9edb8cd6" containerName="istio-proxy"
Oct 30 07:18:20.112155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.112094    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffa7bd5e-abe0-4359-9b61-8046932572b7" containerName="istio-proxy"
Oct 30 07:18:20.118223 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.118202    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.138286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.138262    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"]
Oct 30 07:18:20.147559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.147172    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f7467d-serving-cert\""
Oct 30 07:18:20.259792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.259760    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.259980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.259827    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.259980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.259961    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.260101 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.260077    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94dfb\" (UniqueName: \"kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.365945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.361896    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.365945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.362014    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.365945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.362088    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.365945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.362203    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94dfb\" (UniqueName: \"kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.365945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.363614    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.373576 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.373547    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.373799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.373579    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.397661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.397622    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94dfb\" (UniqueName: \"kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb\") pod \"maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.432477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.432443    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:20.750125 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:18:20.750080    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc226dc_35e2_4a48_a535_3ab6be7076c9.slice/crio-4490ea9ddf98f8f9c66e2d83a6638d2fa58395caff0983622d29a27ada4399e3 WatchSource:0}: Error finding container 4490ea9ddf98f8f9c66e2d83a6638d2fa58395caff0983622d29a27ada4399e3: Status 404 returned error can't find the container with id 4490ea9ddf98f8f9c66e2d83a6638d2fa58395caff0983622d29a27ada4399e3
Oct 30 07:18:20.750249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.750143    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"]
Oct 30 07:18:20.942742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:20.942708    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps" event={"ID":"ecc226dc-35e2-4a48-a535-3ab6be7076c9","Type":"ContainerStarted","Data":"4490ea9ddf98f8f9c66e2d83a6638d2fa58395caff0983622d29a27ada4399e3"}
Oct 30 07:18:21.950930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:21.950897    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps" event={"ID":"ecc226dc-35e2-4a48-a535-3ab6be7076c9","Type":"ContainerStarted","Data":"821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217"}
Oct 30 07:18:21.951335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:21.951041    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:21.997640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:21.997592    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps" podStartSLOduration=1.689171912 podStartE2EDuration="1.997578712s" totalImagesPullingTime="308.4068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:18:21.994507381 +0000 UTC m=+1304.702387567" watchObservedRunningTime="2026-10-30 07:18:21.997578712 +0000 UTC m=+1304.705458881"
Oct 30 07:18:28.024198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:28.024165    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:18:33.600384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.600335    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"]
Oct 30 07:18:33.606295 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.606269    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.626029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.625996    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"]
Oct 30 07:18:33.633944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.633914    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-a-a51baa-serving-cert\""
Oct 30 07:18:33.663429 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.663388    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.663614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.663444    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.663959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.663931    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.664071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.664053    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpw82\" (UniqueName: \"kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.765827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.765775    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.766029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.765949    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpw82\" (UniqueName: \"kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.766114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.766094    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.766172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.766132    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.767151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.767122    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.767269 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:18:33.767228    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-serving-cert: secret "maas-api-e2e-praxis-a-a51baa-serving-cert" not found
Oct 30 07:18:33.767337 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:18:33.767318    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls podName:fcadfd42-0b84-4c73-bf7e-6ef9ec075768 nodeName:}" failed. No retries permitted until 2026-10-30 07:18:34.267295863 +0000 UTC m=+1316.975176009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls") pod "maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" (UID: "fcadfd42-0b84-4c73-bf7e-6ef9ec075768") : secret "maas-api-e2e-praxis-a-a51baa-serving-cert" not found
Oct 30 07:18:33.769585 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.769562    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:33.791230 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:33.791204    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpw82\" (UniqueName: \"kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:34.274731 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:34.274693    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:34.277279 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:34.277252    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\") pod \"maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:34.524119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:34.524087    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:34.862064 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:18:34.862035    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcadfd42_0b84_4c73_bf7e_6ef9ec075768.slice/crio-e1052ccc19429d8130263df551fad4cd686153c9a18e878723265beb18198d24 WatchSource:0}: Error finding container e1052ccc19429d8130263df551fad4cd686153c9a18e878723265beb18198d24: Status 404 returned error can't find the container with id e1052ccc19429d8130263df551fad4cd686153c9a18e878723265beb18198d24
Oct 30 07:18:34.862504 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:34.862440    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"]
Oct 30 07:18:35.071100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:35.071047    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" event={"ID":"fcadfd42-0b84-4c73-bf7e-6ef9ec075768","Type":"ContainerStarted","Data":"e1052ccc19429d8130263df551fad4cd686153c9a18e878723265beb18198d24"}
Oct 30 07:18:36.081085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:36.081041    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" event={"ID":"fcadfd42-0b84-4c73-bf7e-6ef9ec075768","Type":"ContainerStarted","Data":"2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc"}
Oct 30 07:18:36.081593 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:36.081138    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:39.578069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:39.578035    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s_da261456-18ea-441b-b541-29f729790c11/payload-processing/0.log"
Oct 30 07:18:39.826460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:39.826428    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-8r9sh_040eb592-bd9f-4293-9525-703635e87f32/payload-processing/0.log"
Oct 30 07:18:40.059416 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:40.059387    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-8r9sh_040eb592-bd9f-4293-9525-703635e87f32/payload-processing/0.log"
Oct 30 07:18:42.096908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:42.096845    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:18:42.145415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:18:42.145367    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" podStartSLOduration=8.757030248 podStartE2EDuration="9.145352865s" totalImagesPullingTime="388.322617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:18:36.13175599 +0000 UTC m=+1318.839636218" watchObservedRunningTime="2026-10-30 07:18:42.145352865 +0000 UTC m=+1324.853233088"
Oct 30 07:18:43.951223 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:18:43.951182    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:19:13.930973 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:13.930930    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:19:23.294126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.294076    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"]
Oct 30 07:19:23.294618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.294332    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b" podUID="9b40bea9-3d64-43b5-a9f7-875bf2912bb8" containerName="maas-api" containerID="cri-o://be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad" gracePeriod=30
Oct 30 07:19:23.627906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.627835    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:19:23.649285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.649248    5073 generic.go:356] "Generic (PLEG): container finished" podID="9b40bea9-3d64-43b5-a9f7-875bf2912bb8" containerID="be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad" exitCode=0
Oct 30 07:19:23.649460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.649296    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"
Oct 30 07:19:23.649460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.649336    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b" event={"ID":"9b40bea9-3d64-43b5-a9f7-875bf2912bb8","Type":"ContainerDied","Data":"be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad"}
Oct 30 07:19:23.649460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.649404    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b" event={"ID":"9b40bea9-3d64-43b5-a9f7-875bf2912bb8","Type":"ContainerDied","Data":"d003221edc86f4dcc90a3c324cbe7d121e830fc922edf280838ebe1528d2fc4f"}
Oct 30 07:19:23.649460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.649439    5073 scope.go:122] "RemoveContainer" containerID="be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad"
Oct 30 07:19:23.661074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.661054    5073 scope.go:122] "RemoveContainer" containerID="be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad"
Oct 30 07:19:23.661404 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:23.661375    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad\": container with ID starting with be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad not found: ID does not exist" containerID="be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad"
Oct 30 07:19:23.661508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.661406    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad"} err="failed to get container status \"be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad\": rpc error: code = NotFound desc = could not find container \"be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad\": container with ID starting with be5973c7d1553a4004b9b0d831cd66f22fb02b824920059851dbc91251de24ad not found: ID does not exist"
Oct 30 07:19:23.726336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.726295    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca\") pod \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") "
Oct 30 07:19:23.726635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.726607    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng\" (UniqueName: \"kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng\") pod \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") "
Oct 30 07:19:23.726795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.726776    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls\") pod \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") "
Oct 30 07:19:23.726911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.726829    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs\") pod \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\" (UID: \"9b40bea9-3d64-43b5-a9f7-875bf2912bb8\") "
Oct 30 07:19:23.728809 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.728755    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca" pod "9b40bea9-3d64-43b5-a9f7-875bf2912bb8" (UID: "9b40bea9-3d64-43b5-a9f7-875bf2912bb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:19:23.730554 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.730522    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs" pod "9b40bea9-3d64-43b5-a9f7-875bf2912bb8" (UID: "9b40bea9-3d64-43b5-a9f7-875bf2912bb8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:19:23.731191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.731166    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng" pod "9b40bea9-3d64-43b5-a9f7-875bf2912bb8" (UID: "9b40bea9-3d64-43b5-a9f7-875bf2912bb8"). InnerVolumeSpecName "kube-api-access-bghng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:19:23.731984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.731961    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls" pod "9b40bea9-3d64-43b5-a9f7-875bf2912bb8" (UID: "9b40bea9-3d64-43b5-a9f7-875bf2912bb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:19:23.852864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.852660    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:23.852864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.852698    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bghng\" (UniqueName: \"kubernetes.io/projected/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-kube-api-access-bghng\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:23.852864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.852714    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:23.852864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:23.852728    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b40bea9-3d64-43b5-a9f7-875bf2912bb8-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:24.007751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:24.007711    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"]
Oct 30 07:19:24.018670 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:24.018636    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ba67d8-98ddc7d6-gsw2b"]
Oct 30 07:19:25.423518 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:25.423484    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b40bea9-3d64-43b5-a9f7-875bf2912bb8" path="/var/lib/kubelet/pods/9b40bea9-3d64-43b5-a9f7-875bf2912bb8/volumes"
Oct 30 07:19:32.033722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:32.033686    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"]
Oct 30 07:19:32.034335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:32.033943    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy" containerID="cri-o://2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2" gracePeriod=30
Oct 30 07:19:34.828531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:34.828494    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"]
Oct 30 07:19:34.828972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:34.828690    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" podUID="8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" containerName="maas-api" containerID="cri-o://59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996" gracePeriod=30
Oct 30 07:19:35.008069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.008032    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"]
Oct 30 07:19:35.008314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.008282    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s" podUID="da261456-18ea-441b-b541-29f729790c11" containerName="payload-processing" containerID="cri-o://d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab" gracePeriod=30
Oct 30 07:19:35.530931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.530333    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:19:35.554057 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.554027    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:19:35.642860 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.642828    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\") pod \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") "
Oct 30 07:19:35.643029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.642921    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn\" (UniqueName: \"kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn\") pod \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") "
Oct 30 07:19:35.643029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.642985    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume\") pod \"da261456-18ea-441b-b541-29f729790c11\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") "
Oct 30 07:19:35.643124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643030    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs\") pod \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") "
Oct 30 07:19:35.643124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643062    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca\") pod \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\" (UID: \"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37\") "
Oct 30 07:19:35.643221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643147    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj\" (UniqueName: \"kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj\") pod \"da261456-18ea-441b-b541-29f729790c11\" (UID: \"da261456-18ea-441b-b541-29f729790c11\") "
Oct 30 07:19:35.643544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643516    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume" pod "da261456-18ea-441b-b541-29f729790c11" (UID: "da261456-18ea-441b-b541-29f729790c11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:19:35.643646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643542    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca" pod "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" (UID: "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:19:35.643913 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643885    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da261456-18ea-441b-b541-29f729790c11-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:35.644036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.643917    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:35.645596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.645563    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls" pod "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" (UID: "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:19:35.645954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.645922    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs" pod "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" (UID: "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:19:35.646072 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.646006    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn" pod "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" (UID: "8c9cb2d7-fe86-4a63-90a4-43c342d5bf37"). InnerVolumeSpecName "kube-api-access-rxktn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:19:35.646287 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.646261    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj" pod "da261456-18ea-441b-b541-29f729790c11" (UID: "da261456-18ea-441b-b541-29f729790c11"). InnerVolumeSpecName "kube-api-access-q8pdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:19:35.748174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.748073    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:35.748174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.748111    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxktn\" (UniqueName: \"kubernetes.io/projected/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-kube-api-access-rxktn\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:35.748174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.748123    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:35.748174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.748139    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8pdj\" (UniqueName: \"kubernetes.io/projected/da261456-18ea-441b-b541-29f729790c11-kube-api-access-q8pdj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:35.768926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.768804    5073 generic.go:356] "Generic (PLEG): container finished" podID="da261456-18ea-441b-b541-29f729790c11" containerID="d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab" exitCode=0
Oct 30 07:19:35.770546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.768946    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s" event={"ID":"da261456-18ea-441b-b541-29f729790c11","Type":"ContainerDied","Data":"d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab"}
Oct 30 07:19:35.770546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.769279    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s" event={"ID":"da261456-18ea-441b-b541-29f729790c11","Type":"ContainerDied","Data":"1247f0bfda7ae5cb0970848f07486c367e1e1610928e0d5c486aabd80b986bd9"}
Oct 30 07:19:35.770546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.769317    5073 scope.go:122] "RemoveContainer" containerID="d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab"
Oct 30 07:19:35.770546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.768988    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"
Oct 30 07:19:35.773163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.773132    5073 generic.go:356] "Generic (PLEG): container finished" podID="8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" containerID="59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996" exitCode=0
Oct 30 07:19:35.773284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.773183    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" event={"ID":"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37","Type":"ContainerDied","Data":"59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996"}
Oct 30 07:19:35.773284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.773228    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf" event={"ID":"8c9cb2d7-fe86-4a63-90a4-43c342d5bf37","Type":"ContainerDied","Data":"56e1bb6cebf300d6ffac9a78f3940fa63c79841cc40356d2bfc908679326ac8d"}
Oct 30 07:19:35.773393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.773298    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"
Oct 30 07:19:35.794062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.789909    5073 scope.go:122] "RemoveContainer" containerID="d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab"
Oct 30 07:19:35.794062 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:35.791188    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab\": container with ID starting with d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab not found: ID does not exist" containerID="d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab"
Oct 30 07:19:35.794062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.791226    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab"} err="failed to get container status \"d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab\": rpc error: code = NotFound desc = could not find container \"d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab\": container with ID starting with d1dfd68a2aa101c8aa7619c79bfdf12af838a11e50cc94c5fe23f444f863e5ab not found: ID does not exist"
Oct 30 07:19:35.794062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.791249    5073 scope.go:122] "RemoveContainer" containerID="59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996"
Oct 30 07:19:35.813582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.813561    5073 scope.go:122] "RemoveContainer" containerID="59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996"
Oct 30 07:19:35.813983 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:35.813898    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996\": container with ID starting with 59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996 not found: ID does not exist" containerID="59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996"
Oct 30 07:19:35.813983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.813941    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996"} err="failed to get container status \"59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996\": rpc error: code = NotFound desc = could not find container \"59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996\": container with ID starting with 59dc56678ba6c2ba483314ca28f40b6431dba5a325b639badee71af902888996 not found: ID does not exist"
Oct 30 07:19:35.841231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.841210    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"]
Oct 30 07:19:35.846207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.846184    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a273fd-65585cdd9f-gptdf"]
Oct 30 07:19:35.879782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.879745    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"]
Oct 30 07:19:35.885076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:35.885044    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a273fd-56b686b4bd-h6d4s"]
Oct 30 07:19:37.459692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.459662    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:19:37.462537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.462507    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" path="/var/lib/kubelet/pods/8c9cb2d7-fe86-4a63-90a4-43c342d5bf37/volumes"
Oct 30 07:19:37.463314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.463291    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da261456-18ea-441b-b541-29f729790c11" path="/var/lib/kubelet/pods/da261456-18ea-441b-b541-29f729790c11/volumes"
Oct 30 07:19:37.551784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.551741    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.551979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.551838    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.551979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.551900    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.552106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552028    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.552106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552042    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:19:37.552373 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552341    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:19:37.552605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552581    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:19:37.552715 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552635    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.552715 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552699    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.552821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552732    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.552821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552772    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.552821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.552807    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo\") pod \"75d0c198-1615-4458-86c5-df9749fa8b4a\" (UID: \"75d0c198-1615-4458-86c5-df9749fa8b4a\") "
Oct 30 07:19:37.553045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553020    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:19:37.553107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553081    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:19:37.553800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553705    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.553800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553731    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.553800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553746    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.553800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553761    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.553800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.553775    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75d0c198-1615-4458-86c5-df9749fa8b4a-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.555571 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.555543    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:19:37.555695 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.555586    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:19:37.555759 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.555741    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "kube-api-access-bs9kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:19:37.556699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.556673    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy" pod "75d0c198-1615-4458-86c5-df9749fa8b4a" (UID: "75d0c198-1615-4458-86c5-df9749fa8b4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:19:37.655513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.655470    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.655513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.655500    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs9kr\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-kube-api-access-bs9kr\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.655513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.655510    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.655513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.655519    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75d0c198-1615-4458-86c5-df9749fa8b4a-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:37.791130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.791096    5073 generic.go:356] "Generic (PLEG): container finished" podID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerID="2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2" exitCode=0
Oct 30 07:19:37.791314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.791151    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"
Oct 30 07:19:37.791314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.791178    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" event={"ID":"75d0c198-1615-4458-86c5-df9749fa8b4a","Type":"ContainerDied","Data":"2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2"}
Oct 30 07:19:37.791314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.791238    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd" event={"ID":"75d0c198-1615-4458-86c5-df9749fa8b4a","Type":"ContainerDied","Data":"c70f582f02636c1f17a20e096d6c01da0dff88e4caaf338f801d036f8da67c67"}
Oct 30 07:19:37.791314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.791253    5073 scope.go:122] "RemoveContainer" containerID="2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2"
Oct 30 07:19:37.802506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.802490    5073 scope.go:122] "RemoveContainer" containerID="2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2"
Oct 30 07:19:37.802787 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:37.802767    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2\": container with ID starting with 2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2 not found: ID does not exist" containerID="2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2"
Oct 30 07:19:37.802833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.802795    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2"} err="failed to get container status \"2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2\": rpc error: code = NotFound desc = could not find container \"2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2\": container with ID starting with 2e8b4c6e792e5efe90933fc3b967a461318b72637c3331ccae675db5be5294f2 not found: ID does not exist"
Oct 30 07:19:37.842688 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.842666    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"]
Oct 30 07:19:37.853550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:37.853528    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ba67d8-openshift-default-54b4468b87-6mbvd"]
Oct 30 07:19:39.423867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.423825    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" path="/var/lib/kubelet/pods/75d0c198-1615-4458-86c5-df9749fa8b4a/volumes"
Oct 30 07:19:39.795450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.795368    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"]
Oct 30 07:19:39.796152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796129    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9b40bea9-3d64-43b5-a9f7-875bf2912bb8" containerName="maas-api"
Oct 30 07:19:39.796152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796150    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b40bea9-3d64-43b5-a9f7-875bf2912bb8" containerName="maas-api"
Oct 30 07:19:39.796347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796252    5073 cpu_manager.go:414] "containerMap: removing container" podUID="8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" containerName="maas-api"
Oct 30 07:19:39.796347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796263    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" containerName="maas-api"
Oct 30 07:19:39.796347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796284    5073 cpu_manager.go:414] "containerMap: removing container" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy"
Oct 30 07:19:39.796347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796291    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy"
Oct 30 07:19:39.796347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796342    5073 cpu_manager.go:414] "containerMap: removing container" podUID="da261456-18ea-441b-b541-29f729790c11" containerName="payload-processing"
Oct 30 07:19:39.796602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796350    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da261456-18ea-441b-b541-29f729790c11" containerName="payload-processing"
Oct 30 07:19:39.796602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796544    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c9cb2d7-fe86-4a63-90a4-43c342d5bf37" containerName="maas-api"
Oct 30 07:19:39.796602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796560    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="75d0c198-1615-4458-86c5-df9749fa8b4a" containerName="istio-proxy"
Oct 30 07:19:39.796602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796581    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="da261456-18ea-441b-b541-29f729790c11" containerName="payload-processing"
Oct 30 07:19:39.796602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.796593    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b40bea9-3d64-43b5-a9f7-875bf2912bb8" containerName="maas-api"
Oct 30 07:19:39.801905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.801883    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.830962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.829348    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-2340b1-serving-cert\""
Oct 30 07:19:39.835247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.835215    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"]
Oct 30 07:19:39.884003 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.883963    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.884185 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.884139    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.884386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.884361    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.884512 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.884495    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfc49\" (UniqueName: \"kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.999880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.999367    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.999880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.999482    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfc49\" (UniqueName: \"kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.999880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.999609    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:39.999880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:39.999697    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.001476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.001444    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.039594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.033110    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfc49\" (UniqueName: \"kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.039594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.033896    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.043505 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.043474    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.116414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.116322    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.427142 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:19:40.427108    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c23f3da_ec66_4db3_9a64_a22832245aa4.slice/crio-40a538da43323bd6cdc773db12773e6e7e484176e02e20f09774c76927e9df27 WatchSource:0}: Error finding container 40a538da43323bd6cdc773db12773e6e7e484176e02e20f09774c76927e9df27: Status 404 returned error can't find the container with id 40a538da43323bd6cdc773db12773e6e7e484176e02e20f09774c76927e9df27
Oct 30 07:19:40.427943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.427920    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"]
Oct 30 07:19:40.814105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.814070    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk" event={"ID":"5c23f3da-ec66-4db3-9a64-a22832245aa4","Type":"ContainerStarted","Data":"371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5"}
Oct 30 07:19:40.814261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.814124    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk" event={"ID":"5c23f3da-ec66-4db3-9a64-a22832245aa4","Type":"ContainerStarted","Data":"40a538da43323bd6cdc773db12773e6e7e484176e02e20f09774c76927e9df27"}
Oct 30 07:19:40.814261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.814161    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:40.858355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:40.858304    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk" podStartSLOduration=1.584214714 podStartE2EDuration="1.85828994s" totalImagesPullingTime="274.075226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:19:40.854342722 +0000 UTC m=+1383.562222891" watchObservedRunningTime="2026-10-30 07:19:40.85828994 +0000 UTC m=+1383.566170110"
Oct 30 07:19:43.924204 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:43.924143    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:19:46.827522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:46.827492    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:19:47.891557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:47.891360    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"]
Oct 30 07:19:47.892015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:47.891615    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w" podUID="fa8c7b5f-9493-4541-85fe-09ff487ff2f0" containerName="maas-api" containerID="cri-o://47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf" gracePeriod=30
Oct 30 07:19:48.213453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.213424    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:19:48.324338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.324306    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk\" (UniqueName: \"kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk\") pod \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") "
Oct 30 07:19:48.324549 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.324531    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca\") pod \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") "
Oct 30 07:19:48.324643 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.324628    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs\") pod \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") "
Oct 30 07:19:48.324709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.324661    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls\") pod \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\" (UID: \"fa8c7b5f-9493-4541-85fe-09ff487ff2f0\") "
Oct 30 07:19:48.326041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.326009    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca" pod "fa8c7b5f-9493-4541-85fe-09ff487ff2f0" (UID: "fa8c7b5f-9493-4541-85fe-09ff487ff2f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:19:48.328831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.328081    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls" pod "fa8c7b5f-9493-4541-85fe-09ff487ff2f0" (UID: "fa8c7b5f-9493-4541-85fe-09ff487ff2f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:19:48.328831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.328810    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk" pod "fa8c7b5f-9493-4541-85fe-09ff487ff2f0" (UID: "fa8c7b5f-9493-4541-85fe-09ff487ff2f0"). InnerVolumeSpecName "kube-api-access-cblxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:19:48.330033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.330006    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs" pod "fa8c7b5f-9493-4541-85fe-09ff487ff2f0" (UID: "fa8c7b5f-9493-4541-85fe-09ff487ff2f0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:19:48.457933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.448944    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:48.457933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.448982    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:48.457933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.448996    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:48.457933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.449008    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cblxk\" (UniqueName: \"kubernetes.io/projected/fa8c7b5f-9493-4541-85fe-09ff487ff2f0-kube-api-access-cblxk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:19:48.873941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.873813    5073 generic.go:356] "Generic (PLEG): container finished" podID="fa8c7b5f-9493-4541-85fe-09ff487ff2f0" containerID="47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf" exitCode=0
Oct 30 07:19:48.873941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.873872    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"
Oct 30 07:19:48.873941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.873897    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w" event={"ID":"fa8c7b5f-9493-4541-85fe-09ff487ff2f0","Type":"ContainerDied","Data":"47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf"}
Oct 30 07:19:48.874247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.873953    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w" event={"ID":"fa8c7b5f-9493-4541-85fe-09ff487ff2f0","Type":"ContainerDied","Data":"48352a36e199d6907c5457f18fe7756caa28344e404d511cf2e819871ab2ce81"}
Oct 30 07:19:48.874247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.873981    5073 scope.go:122] "RemoveContainer" containerID="47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf"
Oct 30 07:19:48.886816 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.886794    5073 scope.go:122] "RemoveContainer" containerID="47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf"
Oct 30 07:19:48.887104 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:19:48.887080    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf\": container with ID starting with 47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf not found: ID does not exist" containerID="47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf"
Oct 30 07:19:48.887189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.887110    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf"} err="failed to get container status \"47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf\": rpc error: code = NotFound desc = could not find container \"47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf\": container with ID starting with 47897ec01d1a4c1437d02dae8eb376434d7a7ba844c4901f1eff691918d26daf not found: ID does not exist"
Oct 30 07:19:48.939372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.939347    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"]
Oct 30 07:19:48.950739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:48.950718    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c1f203-58dd787d-qnl6w"]
Oct 30 07:19:49.424408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:19:49.424376    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa8c7b5f-9493-4541-85fe-09ff487ff2f0" path="/var/lib/kubelet/pods/fa8c7b5f-9493-4541-85fe-09ff487ff2f0/volumes"
Oct 30 07:20:12.111445 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.111410    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"]
Oct 30 07:20:12.112093 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.111649    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w" podUID="b23571a3-b4cf-4333-96ca-fe822f0aad74" containerName="maas-api" containerID="cri-o://4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8" gracePeriod=30
Oct 30 07:20:12.433588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.433560    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:20:12.501460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.501424    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls\") pod \"b23571a3-b4cf-4333-96ca-fe822f0aad74\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") "
Oct 30 07:20:12.501701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.501543    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm\" (UniqueName: \"kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm\") pod \"b23571a3-b4cf-4333-96ca-fe822f0aad74\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") "
Oct 30 07:20:12.501701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.501586    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs\") pod \"b23571a3-b4cf-4333-96ca-fe822f0aad74\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") "
Oct 30 07:20:12.501917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.501759    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca\") pod \"b23571a3-b4cf-4333-96ca-fe822f0aad74\" (UID: \"b23571a3-b4cf-4333-96ca-fe822f0aad74\") "
Oct 30 07:20:12.502680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.502647    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca" pod "b23571a3-b4cf-4333-96ca-fe822f0aad74" (UID: "b23571a3-b4cf-4333-96ca-fe822f0aad74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:20:12.504755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.504712    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm" pod "b23571a3-b4cf-4333-96ca-fe822f0aad74" (UID: "b23571a3-b4cf-4333-96ca-fe822f0aad74"). InnerVolumeSpecName "kube-api-access-6cmxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:20:12.505248 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.505228    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls" pod "b23571a3-b4cf-4333-96ca-fe822f0aad74" (UID: "b23571a3-b4cf-4333-96ca-fe822f0aad74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:20:12.505340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.505295    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs" pod "b23571a3-b4cf-4333-96ca-fe822f0aad74" (UID: "b23571a3-b4cf-4333-96ca-fe822f0aad74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:20:12.620646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.617607    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b23571a3-b4cf-4333-96ca-fe822f0aad74-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:12.620646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.617646    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:12.620646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.617662    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cmxm\" (UniqueName: \"kubernetes.io/projected/b23571a3-b4cf-4333-96ca-fe822f0aad74-kube-api-access-6cmxm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:12.620646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:12.617676    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b23571a3-b4cf-4333-96ca-fe822f0aad74-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:13.073375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.073336    5073 generic.go:356] "Generic (PLEG): container finished" podID="b23571a3-b4cf-4333-96ca-fe822f0aad74" containerID="4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8" exitCode=0
Oct 30 07:20:13.073596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.073389    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"
Oct 30 07:20:13.073596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.073413    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w" event={"ID":"b23571a3-b4cf-4333-96ca-fe822f0aad74","Type":"ContainerDied","Data":"4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8"}
Oct 30 07:20:13.073596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.073479    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w" event={"ID":"b23571a3-b4cf-4333-96ca-fe822f0aad74","Type":"ContainerDied","Data":"0c8e0f729954a6cf10c06515a62960bf9e7ed4d741ad481f710ad50d4714b62e"}
Oct 30 07:20:13.073596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.073510    5073 scope.go:122] "RemoveContainer" containerID="4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8"
Oct 30 07:20:13.086627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.086605    5073 scope.go:122] "RemoveContainer" containerID="4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8"
Oct 30 07:20:13.087044 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:20:13.086998    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8\": container with ID starting with 4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8 not found: ID does not exist" containerID="4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8"
Oct 30 07:20:13.087187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.087040    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8"} err="failed to get container status \"4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8\": rpc error: code = NotFound desc = could not find container \"4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8\": container with ID starting with 4040c2db95fce685bb2dd8ae817f25b49b9833238b6ac3284fa6ef6ce72cbcf8 not found: ID does not exist"
Oct 30 07:20:13.161876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.161320    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"]
Oct 30 07:20:13.161876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.161386    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-137ec6-778b9bb945-xlf2w"]
Oct 30 07:20:13.423582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:13.423548    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b23571a3-b4cf-4333-96ca-fe822f0aad74" path="/var/lib/kubelet/pods/b23571a3-b4cf-4333-96ca-fe822f0aad74/volumes"
Oct 30 07:20:13.930256 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:20:13.930218    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:20:22.495150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:22.495113    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"]
Oct 30 07:20:22.495713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:22.495356    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy" containerID="cri-o://a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08" gracePeriod=30
Oct 30 07:20:26.001170 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.001129    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"]
Oct 30 07:20:26.002189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.002163    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fa8c7b5f-9493-4541-85fe-09ff487ff2f0" containerName="maas-api"
Oct 30 07:20:26.002366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.002344    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa8c7b5f-9493-4541-85fe-09ff487ff2f0" containerName="maas-api"
Oct 30 07:20:26.002483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.002416    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b23571a3-b4cf-4333-96ca-fe822f0aad74" containerName="maas-api"
Oct 30 07:20:26.002483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.002426    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b23571a3-b4cf-4333-96ca-fe822f0aad74" containerName="maas-api"
Oct 30 07:20:26.002618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.002604    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b23571a3-b4cf-4333-96ca-fe822f0aad74" containerName="maas-api"
Oct 30 07:20:26.002679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.002633    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa8c7b5f-9493-4541-85fe-09ff487ff2f0" containerName="maas-api"
Oct 30 07:20:26.006828 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.006804    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.027245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.027214    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"]
Oct 30 07:20:26.034816 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.034778    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-a-b263d4-serving-cert\""
Oct 30 07:20:26.143054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.143020    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csl6s\" (UniqueName: \"kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.143231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.143066    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.143276 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.143222    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.143358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.143341    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.245254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.245211    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.245473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.245324    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csl6s\" (UniqueName: \"kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.245473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.245355    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.245473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.245446    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.246234 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.246208    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.250457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.250435    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.252675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.250876    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.278202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.278165    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csl6s\" (UniqueName: \"kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s\") pod \"maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.327335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.327300    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:26.645773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:26.645738    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"]
Oct 30 07:20:26.646309 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:20:26.646282    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd675742d_3bdc_45da_83e6_4f7afae00b44.slice/crio-8e4c06db7558c649d6e562a751e2c3fde9b3c0c4210eaf3b4b8393561089a758 WatchSource:0}: Error finding container 8e4c06db7558c649d6e562a751e2c3fde9b3c0c4210eaf3b4b8393561089a758: Status 404 returned error can't find the container with id 8e4c06db7558c649d6e562a751e2c3fde9b3c0c4210eaf3b4b8393561089a758
Oct 30 07:20:27.234533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.234493    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx" event={"ID":"d675742d-3bdc-45da-83e6-4f7afae00b44","Type":"ContainerStarted","Data":"3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d"}
Oct 30 07:20:27.235045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.234563    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx" event={"ID":"d675742d-3bdc-45da-83e6-4f7afae00b44","Type":"ContainerStarted","Data":"8e4c06db7558c649d6e562a751e2c3fde9b3c0c4210eaf3b4b8393561089a758"}
Oct 30 07:20:27.235045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.234710    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:27.278971 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.278917    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx" podStartSLOduration=1.889557098 podStartE2EDuration="2.278901662s" totalImagesPullingTime="389.344564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:20:27.274545765 +0000 UTC m=+1429.982425934" watchObservedRunningTime="2026-10-30 07:20:27.278901662 +0000 UTC m=+1429.986781844"
Oct 30 07:20:27.809785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.809708    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:20:27.899061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899017    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899092    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899203    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899401 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899335    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899398    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899437    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899443    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:20:27.899466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899463    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899610    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899665    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:20:27.899684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899678    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9\") pod \"191b6ce6-8636-4426-a602-b608fa3d51d1\" (UID: \"191b6ce6-8636-4426-a602-b608fa3d51d1\") "
Oct 30 07:20:27.899841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899587    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:20:27.899944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.899887    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:20:27.900510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.900203    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:20:27.900510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.900419    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:27.900510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.900440    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/191b6ce6-8636-4426-a602-b608fa3d51d1-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:27.900510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.900454    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:27.900510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.900467    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:27.900510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.900481    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:27.901954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.901929    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:20:27.903213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.903179    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:20:27.903453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.903426    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "kube-api-access-r6lc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:20:27.903640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:27.903619    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy" pod "191b6ce6-8636-4426-a602-b608fa3d51d1" (UID: "191b6ce6-8636-4426-a602-b608fa3d51d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:20:28.002338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.002307    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:28.002338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.002340    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:28.002634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.002352    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6lc9\" (UniqueName: \"kubernetes.io/projected/191b6ce6-8636-4426-a602-b608fa3d51d1-kube-api-access-r6lc9\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:28.002634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.002361    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/191b6ce6-8636-4426-a602-b608fa3d51d1-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:28.297945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.297904    5073 generic.go:356] "Generic (PLEG): container finished" podID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerID="a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08" exitCode=0
Oct 30 07:20:28.300006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.299980    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"
Oct 30 07:20:28.307477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.307440    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" event={"ID":"191b6ce6-8636-4426-a602-b608fa3d51d1","Type":"ContainerDied","Data":"a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08"}
Oct 30 07:20:28.308808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.308780    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4" event={"ID":"191b6ce6-8636-4426-a602-b608fa3d51d1","Type":"ContainerDied","Data":"0745ac672450babff2cdd4e95abf6e8efad7c45ff8d00cf1954286019e5db7d5"}
Oct 30 07:20:28.309019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.308810    5073 scope.go:122] "RemoveContainer" containerID="a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08"
Oct 30 07:20:28.322396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.322377    5073 scope.go:122] "RemoveContainer" containerID="a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08"
Oct 30 07:20:28.322726 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:20:28.322696    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08\": container with ID starting with a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08 not found: ID does not exist" containerID="a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08"
Oct 30 07:20:28.322726 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.322735    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08"} err="failed to get container status \"a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08\": rpc error: code = NotFound desc = could not find container \"a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08\": container with ID starting with a8d56713c5a9d902e22949467e7b09a77ffb6e04167c19649b8b0660ee569d08 not found: ID does not exist"
Oct 30 07:20:28.358496 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.358465    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"]
Oct 30 07:20:28.372435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:28.372411    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-njxf4"]
Oct 30 07:20:29.424234 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:29.424195    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" path="/var/lib/kubelet/pods/191b6ce6-8636-4426-a602-b608fa3d51d1/volumes"
Oct 30 07:20:33.306123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:33.306092    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:20:33.768657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:33.768619    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"]
Oct 30 07:20:33.768930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:33.768902    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps" podUID="ecc226dc-35e2-4a48-a535-3ab6be7076c9" containerName="maas-api" containerID="cri-o://821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217" gracePeriod=30
Oct 30 07:20:34.198358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.198329    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:20:34.353550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.353513    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb\" (UniqueName: \"kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb\") pod \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") "
Oct 30 07:20:34.354136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.353594    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca\") pod \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") "
Oct 30 07:20:34.354136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.353695    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls\") pod \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") "
Oct 30 07:20:34.354136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.353811    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs\") pod \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\" (UID: \"ecc226dc-35e2-4a48-a535-3ab6be7076c9\") "
Oct 30 07:20:34.356214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.356181    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca" pod "ecc226dc-35e2-4a48-a535-3ab6be7076c9" (UID: "ecc226dc-35e2-4a48-a535-3ab6be7076c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:20:34.358152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.357694    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs" pod "ecc226dc-35e2-4a48-a535-3ab6be7076c9" (UID: "ecc226dc-35e2-4a48-a535-3ab6be7076c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:20:34.358152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.357727    5073 generic.go:356] "Generic (PLEG): container finished" podID="ecc226dc-35e2-4a48-a535-3ab6be7076c9" containerID="821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217" exitCode=0
Oct 30 07:20:34.358152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.357807    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"
Oct 30 07:20:34.359061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.358566    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps" event={"ID":"ecc226dc-35e2-4a48-a535-3ab6be7076c9","Type":"ContainerDied","Data":"821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217"}
Oct 30 07:20:34.359061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.358627    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps" event={"ID":"ecc226dc-35e2-4a48-a535-3ab6be7076c9","Type":"ContainerDied","Data":"4490ea9ddf98f8f9c66e2d83a6638d2fa58395caff0983622d29a27ada4399e3"}
Oct 30 07:20:34.359061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.358657    5073 scope.go:122] "RemoveContainer" containerID="821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217"
Oct 30 07:20:34.438212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.401762    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb" pod "ecc226dc-35e2-4a48-a535-3ab6be7076c9" (UID: "ecc226dc-35e2-4a48-a535-3ab6be7076c9"). InnerVolumeSpecName "kube-api-access-94dfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:20:34.469642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.469597    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls" pod "ecc226dc-35e2-4a48-a535-3ab6be7076c9" (UID: "ecc226dc-35e2-4a48-a535-3ab6be7076c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:20:34.474617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.474586    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:34.474927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.474886    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecc226dc-35e2-4a48-a535-3ab6be7076c9-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:34.475094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.475061    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94dfb\" (UniqueName: \"kubernetes.io/projected/ecc226dc-35e2-4a48-a535-3ab6be7076c9-kube-api-access-94dfb\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:34.475211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.475197    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc226dc-35e2-4a48-a535-3ab6be7076c9-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:20:34.504678 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.504557    5073 scope.go:122] "RemoveContainer" containerID="821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217"
Oct 30 07:20:34.504984 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:20:34.504956    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217\": container with ID starting with 821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217 not found: ID does not exist" containerID="821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217"
Oct 30 07:20:34.505100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.504995    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217"} err="failed to get container status \"821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217\": rpc error: code = NotFound desc = could not find container \"821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217\": container with ID starting with 821098e1dbb06e7b290b10d300e857390a93297c7d57320d049de1e4cc6ea217 not found: ID does not exist"
Oct 30 07:20:34.707917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.707800    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"]
Oct 30 07:20:34.712622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:34.712592    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7467d-58f698c857-r59ps"]
Oct 30 07:20:35.423677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:35.423644    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecc226dc-35e2-4a48-a535-3ab6be7076c9" path="/var/lib/kubelet/pods/ecc226dc-35e2-4a48-a535-3ab6be7076c9/volumes"
Oct 30 07:20:37.865238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:37.865203    5073 scope.go:122] "RemoveContainer" containerID="131b6b9f07c98a292afb81036ea428f39e0794f24049603e63781dd63b128dc8"
Oct 30 07:20:43.932546 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:20:43.931210    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:20:55.300940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.300901    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"]
Oct 30 07:20:55.301537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.301523    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ecc226dc-35e2-4a48-a535-3ab6be7076c9" containerName="maas-api"
Oct 30 07:20:55.301581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.301538    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecc226dc-35e2-4a48-a535-3ab6be7076c9" containerName="maas-api"
Oct 30 07:20:55.301581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.301563    5073 cpu_manager.go:414] "containerMap: removing container" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy"
Oct 30 07:20:55.301581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.301568    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy"
Oct 30 07:20:55.301709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.301698    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecc226dc-35e2-4a48-a535-3ab6be7076c9" containerName="maas-api"
Oct 30 07:20:55.301747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.301713    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="191b6ce6-8636-4426-a602-b608fa3d51d1" containerName="istio-proxy"
Oct 30 07:20:55.306972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.306946    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.320694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.320662    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-8d44bf-serving-cert\""
Oct 30 07:20:55.336152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.336121    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"]
Oct 30 07:20:55.440642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.440611    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.440642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.440646    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxqr7\" (UniqueName: \"kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.440990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.440679    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.440990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.440790    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.542148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.542113    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.542148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.542151    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxqr7\" (UniqueName: \"kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.542411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.542204    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.542411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.542356    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.543188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.543159    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.545043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.545021    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.545180 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.545162    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.586820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.586336    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxqr7\" (UniqueName: \"kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7\") pod \"maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.621139 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.620873    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:55.930012 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:20:55.929982    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972cf62c_016d_458c_ad59_663c1a881e81.slice/crio-d70f92bb8540c7b2794c19c0eae38264a5816be6bd9ab6f91cceef5d67d6c0cc WatchSource:0}: Error finding container d70f92bb8540c7b2794c19c0eae38264a5816be6bd9ab6f91cceef5d67d6c0cc: Status 404 returned error can't find the container with id d70f92bb8540c7b2794c19c0eae38264a5816be6bd9ab6f91cceef5d67d6c0cc
Oct 30 07:20:55.930209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:55.930183    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"]
Oct 30 07:20:56.525769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:56.525729    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6" event={"ID":"972cf62c-016d-458c-ad59-663c1a881e81","Type":"ContainerStarted","Data":"9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96"}
Oct 30 07:20:56.526231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:56.525833    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:20:56.526231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:56.525891    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6" event={"ID":"972cf62c-016d-458c-ad59-663c1a881e81","Type":"ContainerStarted","Data":"d70f92bb8540c7b2794c19c0eae38264a5816be6bd9ab6f91cceef5d67d6c0cc"}
Oct 30 07:20:56.568564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:20:56.568463    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6" podStartSLOduration=1.185041104 podStartE2EDuration="1.568402064s" totalImagesPullingTime="383.36096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:20:56.566800405 +0000 UTC m=+1459.274680571" watchObservedRunningTime="2026-10-30 07:20:56.568402064 +0000 UTC m=+1459.276282230"
Oct 30 07:21:02.538284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:02.538252    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:21:03.140577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.140533    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"]
Oct 30 07:21:03.141097 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.141064    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq" podUID="66cb9228-2518-47ab-94ab-4864484ff7c8" containerName="maas-api" containerID="cri-o://b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790" gracePeriod=30
Oct 30 07:21:03.473079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.473044    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:21:03.576484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.576442    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl\" (UniqueName: \"kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl\") pod \"66cb9228-2518-47ab-94ab-4864484ff7c8\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") "
Oct 30 07:21:03.577000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.576594    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs\") pod \"66cb9228-2518-47ab-94ab-4864484ff7c8\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") "
Oct 30 07:21:03.577000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.576746    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca\") pod \"66cb9228-2518-47ab-94ab-4864484ff7c8\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") "
Oct 30 07:21:03.577000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.576797    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls\") pod \"66cb9228-2518-47ab-94ab-4864484ff7c8\" (UID: \"66cb9228-2518-47ab-94ab-4864484ff7c8\") "
Oct 30 07:21:03.578247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.578174    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca" pod "66cb9228-2518-47ab-94ab-4864484ff7c8" (UID: "66cb9228-2518-47ab-94ab-4864484ff7c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:21:03.579585 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.579552    5073 generic.go:356] "Generic (PLEG): container finished" podID="66cb9228-2518-47ab-94ab-4864484ff7c8" containerID="b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790" exitCode=0
Oct 30 07:21:03.579703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.579684    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq" event={"ID":"66cb9228-2518-47ab-94ab-4864484ff7c8","Type":"ContainerDied","Data":"b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790"}
Oct 30 07:21:03.579768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.579732    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq" event={"ID":"66cb9228-2518-47ab-94ab-4864484ff7c8","Type":"ContainerDied","Data":"8f8e0b71ccad1765a28689990cf2d56b72fe3e5d8f4d7176c238aba3d1b8f109"}
Oct 30 07:21:03.579768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.579762    5073 scope.go:122] "RemoveContainer" containerID="b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790"
Oct 30 07:21:03.581200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.580279    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"
Oct 30 07:21:03.582810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.582787    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl" pod "66cb9228-2518-47ab-94ab-4864484ff7c8" (UID: "66cb9228-2518-47ab-94ab-4864484ff7c8"). InnerVolumeSpecName "kube-api-access-m64zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:21:03.583368 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.583332    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls" pod "66cb9228-2518-47ab-94ab-4864484ff7c8" (UID: "66cb9228-2518-47ab-94ab-4864484ff7c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:21:03.586277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.586250    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs" pod "66cb9228-2518-47ab-94ab-4864484ff7c8" (UID: "66cb9228-2518-47ab-94ab-4864484ff7c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:21:03.624285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.624254    5073 scope.go:122] "RemoveContainer" containerID="b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790"
Oct 30 07:21:03.624645 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:03.624619    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790\": container with ID starting with b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790 not found: ID does not exist" containerID="b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790"
Oct 30 07:21:03.624700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.624653    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790"} err="failed to get container status \"b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790\": rpc error: code = NotFound desc = could not find container \"b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790\": container with ID starting with b6e498a6b6eb2fd11833974544f862ca0d917214cb6fbeabce479364b5777790 not found: ID does not exist"
Oct 30 07:21:03.691638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.691052    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66cb9228-2518-47ab-94ab-4864484ff7c8-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:03.691638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.691095    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:03.691638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.691113    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m64zl\" (UniqueName: \"kubernetes.io/projected/66cb9228-2518-47ab-94ab-4864484ff7c8-kube-api-access-m64zl\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:03.691638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.691126    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66cb9228-2518-47ab-94ab-4864484ff7c8-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:03.966912 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.966814    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"]
Oct 30 07:21:03.984537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:03.984496    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-092c5c-66fdd89d9f-czznq"]
Oct 30 07:21:05.423917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:05.423885    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66cb9228-2518-47ab-94ab-4864484ff7c8" path="/var/lib/kubelet/pods/66cb9228-2518-47ab-94ab-4864484ff7c8/volumes"
Oct 30 07:21:08.139995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.139954    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"]
Oct 30 07:21:08.140892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.140826    5073 cpu_manager.go:414] "containerMap: removing container" podUID="66cb9228-2518-47ab-94ab-4864484ff7c8" containerName="maas-api"
Oct 30 07:21:08.140892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.140865    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66cb9228-2518-47ab-94ab-4864484ff7c8" containerName="maas-api"
Oct 30 07:21:08.141094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.141079    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="66cb9228-2518-47ab-94ab-4864484ff7c8" containerName="maas-api"
Oct 30 07:21:08.146326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.146305    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.169599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.169553    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"]
Oct 30 07:21:08.215400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.215367    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-a-2504c2-serving-cert\""
Oct 30 07:21:08.262582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.262553    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.262880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.262596    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.262880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.262714    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.262880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.262742    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2crk\" (UniqueName: \"kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.363960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.363925    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.364140 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.363978    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.364140 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.364097    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.364255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.364141    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2crk\" (UniqueName: \"kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.364800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.364771    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.366707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.366686    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.366987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.366965    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.387465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.387430    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2crk\" (UniqueName: \"kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk\") pod \"maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.462504 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.462420    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:08.768993 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:21:08.768960    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e866e08_76dc_49da_90c1_ac0ca6334717.slice/crio-1cc2c46ff7c9b8958e90b64385e789232d0b64766edbe410070c3465af657766 WatchSource:0}: Error finding container 1cc2c46ff7c9b8958e90b64385e789232d0b64766edbe410070c3465af657766: Status 404 returned error can't find the container with id 1cc2c46ff7c9b8958e90b64385e789232d0b64766edbe410070c3465af657766
Oct 30 07:21:08.768993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:08.768977    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"]
Oct 30 07:21:09.629348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:09.629304    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9" event={"ID":"2e866e08-76dc-49da-90c1-ac0ca6334717","Type":"ContainerStarted","Data":"c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013"}
Oct 30 07:21:09.629767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:09.629404    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:09.629767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:09.629430    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9" event={"ID":"2e866e08-76dc-49da-90c1-ac0ca6334717","Type":"ContainerStarted","Data":"1cc2c46ff7c9b8958e90b64385e789232d0b64766edbe410070c3465af657766"}
Oct 30 07:21:09.672001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:09.671942    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9" podStartSLOduration=1.361296845 podStartE2EDuration="1.671925619s" totalImagesPullingTime="310.628774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:21:09.66942499 +0000 UTC m=+1472.377305159" watchObservedRunningTime="2026-10-30 07:21:09.671925619 +0000 UTC m=+1472.379805789"
Oct 30 07:21:11.284811 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:11.284769    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"]
Oct 30 07:21:11.285333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:11.285069    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy" containerID="cri-o://c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b" gracePeriod=30
Oct 30 07:21:13.926143 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:13.926108    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:21:15.642648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:15.642618    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:21:16.591426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.591402    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:21:16.712626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712596    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712683    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712713    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712704    5073 generic.go:356] "Generic (PLEG): container finished" podID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerID="c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b" exitCode=0
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712743    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712822    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712838    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712881    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712906    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712916    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" event={"ID":"9d0a1d28-c6e4-4356-934f-a66b0606708e","Type":"ContainerDied","Data":"c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b"}
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712947    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712962    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh" event={"ID":"9d0a1d28-c6e4-4356-934f-a66b0606708e","Type":"ContainerDied","Data":"5ade2d7b7a44f50f5f0c1a9fc4a27469e627c0f98bdfb4c6e311ad15b28220f9"}
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712996    5073 scope.go:122] "RemoveContainer" containerID="c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b"
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713014    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713050    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:21:16.713111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.712997    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713130    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo\") pod \"9d0a1d28-c6e4-4356-934f-a66b0606708e\" (UID: \"9d0a1d28-c6e4-4356-934f-a66b0606708e\") "
Oct 30 07:21:16.713928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713374    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:21:16.713928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713408    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:21:16.713928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713894    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d0a1d28-c6e4-4356-934f-a66b0606708e-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.713928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713918    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.714200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713932    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.714200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713946    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.714200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.713994    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.715473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.715446    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:21:16.715579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.715501    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:21:16.715579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.715563    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "kube-api-access-p45tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:21:16.715911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.715889    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo" pod "9d0a1d28-c6e4-4356-934f-a66b0606708e" (UID: "9d0a1d28-c6e4-4356-934f-a66b0606708e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:21:16.745135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.745114    5073 scope.go:122] "RemoveContainer" containerID="c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b"
Oct 30 07:21:16.745405 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:16.745382    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b\": container with ID starting with c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b not found: ID does not exist" containerID="c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b"
Oct 30 07:21:16.745480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.745413    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b"} err="failed to get container status \"c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b\": rpc error: code = NotFound desc = could not find container \"c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b\": container with ID starting with c80c28d00117ae4878317b78f7d21a72975244c8bed773b95c5f2c457a26546b not found: ID does not exist"
Oct 30 07:21:16.815298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.815210    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.815298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.815243    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.815298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.815257    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p45tz\" (UniqueName: \"kubernetes.io/projected/9d0a1d28-c6e4-4356-934f-a66b0606708e-kube-api-access-p45tz\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:16.815298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:16.815269    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d0a1d28-c6e4-4356-934f-a66b0606708e-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:21:17.059376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:17.059345    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"]
Oct 30 07:21:17.070556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:17.070488    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-6w5sh"]
Oct 30 07:21:17.424820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:17.424777    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" path="/var/lib/kubelet/pods/9d0a1d28-c6e4-4356-934f-a66b0606708e/volumes"
Oct 30 07:21:24.653601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.653567    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"]
Oct 30 07:21:24.654269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.654253    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy"
Oct 30 07:21:24.654316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.654272    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy"
Oct 30 07:21:24.654407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.654397    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d0a1d28-c6e4-4356-934f-a66b0606708e" containerName="istio-proxy"
Oct 30 07:21:24.659465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.659449    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.675432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.675409    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-704bf6-serving-cert\""
Oct 30 07:21:24.692709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.692683    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"]
Oct 30 07:21:24.759155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.759124    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.759316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.759187    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.759391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.759370    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsxxz\" (UniqueName: \"kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.759508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.759490    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.861579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.861536    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.861804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.861711    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsxxz\" (UniqueName: \"kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.861804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.861790    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.862069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.861901    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.863264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.863237    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.866261 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:24.863569    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-serving-cert: secret "maas-api-e2e-praxis-b-704bf6-serving-cert" not found
Oct 30 07:21:24.867078 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:24.867021    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls podName:2cdeeda2-4c8c-484c-874d-1bf5583f67ff nodeName:}" failed. No retries permitted until 2026-10-30 07:21:25.36698685 +0000 UTC m=+1488.074867037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls") pod "maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" (UID: "2cdeeda2-4c8c-484c-874d-1bf5583f67ff") : secret "maas-api-e2e-praxis-b-704bf6-serving-cert" not found
Oct 30 07:21:24.871452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.871411    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:24.894198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:24.894109    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsxxz\" (UniqueName: \"kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:25.367529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:25.367496    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:25.369894 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:25.369864    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\") pod \"maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:25.584923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:25.575104    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:25.896575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:25.896525    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"]
Oct 30 07:21:25.896923 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:21:25.896615    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdeeda2_4c8c_484c_874d_1bf5583f67ff.slice/crio-395129fb549d2e94ac919f0ebd1556a47a89baa30f4283a5fe3152f6a677fc5e WatchSource:0}: Error finding container 395129fb549d2e94ac919f0ebd1556a47a89baa30f4283a5fe3152f6a677fc5e: Status 404 returned error can't find the container with id 395129fb549d2e94ac919f0ebd1556a47a89baa30f4283a5fe3152f6a677fc5e
Oct 30 07:21:26.790220 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:26.790177    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" event={"ID":"2cdeeda2-4c8c-484c-874d-1bf5583f67ff","Type":"ContainerStarted","Data":"e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7"}
Oct 30 07:21:26.790780 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:26.790263    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" event={"ID":"2cdeeda2-4c8c-484c-874d-1bf5583f67ff","Type":"ContainerStarted","Data":"395129fb549d2e94ac919f0ebd1556a47a89baa30f4283a5fe3152f6a677fc5e"}
Oct 30 07:21:26.791148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:26.791129    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:26.831502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:26.831449    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" podStartSLOduration=2.462013267 podStartE2EDuration="2.831435463s" totalImagesPullingTime="369.422196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:21:26.831069254 +0000 UTC m=+1489.538949418" watchObservedRunningTime="2026-10-30 07:21:26.831435463 +0000 UTC m=+1489.539315631"
Oct 30 07:21:33.810669 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:33.810636    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:21:37.845093 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:37.845058    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:21:37.851697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:37.851673    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:21:40.460817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.460785    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"]
Oct 30 07:21:40.467765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.467741    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.491059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.487762    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-a-45b148-serving-cert\""
Oct 30 07:21:40.491059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.490165    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"]
Oct 30 07:21:40.505915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.503893    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.505915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.504008    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.505915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.504061    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.505915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.504149    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgw6v\" (UniqueName: \"kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.606717    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.606787    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.606914    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgw6v\" (UniqueName: \"kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.607071    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:40.609984    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-serving-cert: secret "maas-api-e2e-praxis-a-45b148-serving-cert" not found
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:40.610060    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls podName:4bcf9265-2ef3-46db-a90c-a656fb09a138 nodeName:}" failed. No retries permitted until 2026-10-30 07:21:41.110038481 +0000 UTC m=+1503.817918627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls") pod "maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" (UID: "4bcf9265-2ef3-46db-a90c-a656fb09a138") : secret "maas-api-e2e-praxis-a-45b148-serving-cert" not found
Oct 30 07:21:40.611871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.610951    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.614718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.614693    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:40.634191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:40.633735    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgw6v\" (UniqueName: \"kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:41.115487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:41.115451    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:41.117955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:41.117926    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\") pod \"maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:41.383931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:41.383893    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:41.697056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:41.697024    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"]
Oct 30 07:21:41.697495 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:21:41.697146    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcf9265_2ef3_46db_a90c_a656fb09a138.slice/crio-a4891cb92a6e2050709d374e3bb3620db992ed462396c50249df4d13026f8e84 WatchSource:0}: Error finding container a4891cb92a6e2050709d374e3bb3620db992ed462396c50249df4d13026f8e84: Status 404 returned error can't find the container with id a4891cb92a6e2050709d374e3bb3620db992ed462396c50249df4d13026f8e84
Oct 30 07:21:41.909720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:41.909623    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" event={"ID":"4bcf9265-2ef3-46db-a90c-a656fb09a138","Type":"ContainerStarted","Data":"a4891cb92a6e2050709d374e3bb3620db992ed462396c50249df4d13026f8e84"}
Oct 30 07:21:42.919149 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:42.919106    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" event={"ID":"4bcf9265-2ef3-46db-a90c-a656fb09a138","Type":"ContainerStarted","Data":"90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f"}
Oct 30 07:21:42.919625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:42.919191    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:42.962418 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:42.962368    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" podStartSLOduration=2.63069042 podStartE2EDuration="2.962354321s" totalImagesPullingTime="331.663901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:21:42.959324721 +0000 UTC m=+1505.667204890" watchObservedRunningTime="2026-10-30 07:21:42.962354321 +0000 UTC m=+1505.670234490"
Oct 30 07:21:43.926056 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:21:43.926016    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:21:48.935384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:48.935347    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:21:56.837005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.836956    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"]
Oct 30 07:21:56.842792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.842768    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.856971 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.856942    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-b-704bf6-openshift-default-dockercfg-dtdjx\""
Oct 30 07:21:56.876390 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.876362    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"]
Oct 30 07:21:56.940392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940346    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69b2d\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940554 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940493    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940554 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940526    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940636    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940700    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940818 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940804    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940847    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.940966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940949    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:56.941001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:56.940986    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042192    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042249    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042309    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042355    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042585 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042556    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042610    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.042719 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042696    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69b2d\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042720    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042820    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.043066    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042932    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.043036    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.043152    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.043222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.042990    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.044706 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.044679    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.045428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.045405    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.064682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.064657    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.064842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.064824    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69b2d\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d\") pod \"e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") " pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.157756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.157722    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:57.486622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.486587    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"]
Oct 30 07:21:57.489612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.489569    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:21:57.489727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.489654    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:21:57.489727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:57.489693    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:21:58.070144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:58.070102    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" event={"ID":"47ca7c2a-306f-4276-817e-80af65dd8f30","Type":"ContainerStarted","Data":"72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519"}
Oct 30 07:21:58.070605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:58.070168    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" event={"ID":"47ca7c2a-306f-4276-817e-80af65dd8f30","Type":"ContainerStarted","Data":"b9ca6fb98100ecb0071b33c0fee0c47fbd5822beb48dbc5b4897e5505a963672"}
Oct 30 07:21:58.144049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:58.143962    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podStartSLOduration=2.143937527 podStartE2EDuration="2.143937527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:21:58.125437082 +0000 UTC m=+1520.833317252" watchObservedRunningTime="2026-10-30 07:21:58.143937527 +0000 UTC m=+1520.851817699"
Oct 30 07:21:58.158498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:58.158458    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:21:58.160474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:58.160448    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 07:21:58.160586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:58.160493    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 07:21:59.158492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:59.158457    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 07:21:59.158936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:21:59.158508    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 07:22:00.158358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:00.158325    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 07:22:00.158544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:00.158379    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 07:22:01.158428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:01.158391    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 07:22:01.158600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:01.158452    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 07:22:02.158508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:02.158470    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 07:22:02.158694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:02.158531    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 07:22:03.158408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:03.158375    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 07:22:03.158663 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:03.158640    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 07:22:04.162967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:04.162932    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:22:04.163442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:04.163405    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:22:04.164008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:04.163984    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:22:13.888311 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.888277    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"]
Oct 30 07:22:13.893209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.893185    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:13.908604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.908578    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-411c9d-serving-cert\""
Oct 30 07:22:13.929899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.929842    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"]
Oct 30 07:22:13.939588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.939540    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:13.939802 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.939782    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d4b\" (UniqueName: \"kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:13.939874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.939829    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:13.939926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:13.939889    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:13.941783 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:13.941751    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:22:14.041074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.041042    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d4b\" (UniqueName: \"kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.041252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.041085    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.041252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.041116    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.041252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.041214    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.041788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.041764    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.043595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.043573    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.043704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.043692    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.063384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.063356    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d4b\" (UniqueName: \"kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b\") pod \"maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.212600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.212500    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:14.522338 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:22:14.522301    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8448edb3_57f8_45a4_a2bd_c35580797999.slice/crio-ae8bf4abc396b27bb5c1c6c6e89ead8385627237d33df2a1397cecea5441a4a0 WatchSource:0}: Error finding container ae8bf4abc396b27bb5c1c6c6e89ead8385627237d33df2a1397cecea5441a4a0: Status 404 returned error can't find the container with id ae8bf4abc396b27bb5c1c6c6e89ead8385627237d33df2a1397cecea5441a4a0
Oct 30 07:22:14.523539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:14.523516    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"]
Oct 30 07:22:15.447558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:15.447513    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" event={"ID":"8448edb3-57f8-45a4-a2bd-c35580797999","Type":"ContainerStarted","Data":"72bd7d3b6abb46da2ba40acd4dab74dafbe072a3f05221b186553e3a73a5c43e"}
Oct 30 07:22:15.447953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:15.447596    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:15.447953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:15.447631    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" event={"ID":"8448edb3-57f8-45a4-a2bd-c35580797999","Type":"ContainerStarted","Data":"ae8bf4abc396b27bb5c1c6c6e89ead8385627237d33df2a1397cecea5441a4a0"}
Oct 30 07:22:15.478924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:15.478839    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" podStartSLOduration=2.156816026 podStartE2EDuration="2.478820969s" totalImagesPullingTime="322.004943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:22:15.475272035 +0000 UTC m=+1538.183152204" watchObservedRunningTime="2026-10-30 07:22:15.478820969 +0000 UTC m=+1538.186701139"
Oct 30 07:22:15.910531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:15.910493    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"]
Oct 30 07:22:15.910720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:15.910695    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" containerID="cri-o://807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4" gracePeriod=30
Oct 30 07:22:16.172106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:16.172014    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:22:16.172282 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:16.172094    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:22:21.217354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.217320    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:22:21.318927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.318890    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.318975    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319042    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319079    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319138    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319268    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319308    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319311    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:21.319426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319397    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319431    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket\") pod \"6db2a540-2696-4277-89f3-27012f35f846\" (UID: \"6db2a540-2696-4277-89f3-27012f35f846\") "
Oct 30 07:22:21.319579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.319441    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:21.320062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.320035    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6db2a540-2696-4277-89f3-27012f35f846-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.320162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.320066    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.322215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.320290    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:21.322215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.320396    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:21.322215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.320456    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:21.324454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.324427    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:22:21.324962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.324939    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:21.325761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.325732    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "kube-api-access-rwnwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:21.326213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.326191    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token" pod "6db2a540-2696-4277-89f3-27012f35f846" (UID: "6db2a540-2696-4277-89f3-27012f35f846"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429571    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429610    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429624    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwnwh\" (UniqueName: \"kubernetes.io/projected/6db2a540-2696-4277-89f3-27012f35f846-kube-api-access-rwnwh\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429637    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429650    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6db2a540-2696-4277-89f3-27012f35f846-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429662    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.430684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.429827    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6db2a540-2696-4277-89f3-27012f35f846-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:21.555972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.547393    5073 generic.go:356] "Generic (PLEG): container finished" podID="6db2a540-2696-4277-89f3-27012f35f846" containerID="807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4" exitCode=0
Oct 30 07:22:21.555972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.547647    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" event={"ID":"6db2a540-2696-4277-89f3-27012f35f846","Type":"ContainerDied","Data":"807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4"}
Oct 30 07:22:21.555972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.547701    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr" event={"ID":"6db2a540-2696-4277-89f3-27012f35f846","Type":"ContainerDied","Data":"4af04dbf755afbc86bf9a3d8bd0ffc88e5f1c94c79d986cd3878c9d23b32e714"}
Oct 30 07:22:21.555972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.547730    5073 scope.go:122] "RemoveContainer" containerID="807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4"
Oct 30 07:22:21.555972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.547916    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"
Oct 30 07:22:21.555972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.549941    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:22:21.603515 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.603481    5073 scope.go:122] "RemoveContainer" containerID="0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"
Oct 30 07:22:21.624141 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.624119    5073 scope.go:122] "RemoveContainer" containerID="807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4"
Oct 30 07:22:21.624566 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:21.624538    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4\": container with ID starting with 807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4 not found: ID does not exist" containerID="807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4"
Oct 30 07:22:21.624776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.624742    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4"} err="failed to get container status \"807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4\": rpc error: code = NotFound desc = could not find container \"807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4\": container with ID starting with 807ab5dee98f3177afa5ccf19e49368bfc7ed2981d93ed3c99c1d4f62a3ac4c4 not found: ID does not exist"
Oct 30 07:22:21.624895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.624777    5073 scope.go:122] "RemoveContainer" containerID="0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"
Oct 30 07:22:21.625197 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:21.625168    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9\": container with ID starting with 0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9 not found: ID does not exist" containerID="0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"
Oct 30 07:22:21.625300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.625209    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9"} err="failed to get container status \"0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9\": rpc error: code = NotFound desc = could not find container \"0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9\": container with ID starting with 0471299efcc40bfeace356707d41c20293cdd9c5b68e171ec67ccad2a9cd0bc9 not found: ID does not exist"
Oct 30 07:22:21.654230 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.654195    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"]
Oct 30 07:22:21.659409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:21.659385    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-65cwr"]
Oct 30 07:22:23.423762 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:23.423730    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6db2a540-2696-4277-89f3-27012f35f846" path="/var/lib/kubelet/pods/6db2a540-2696-4277-89f3-27012f35f846/volumes"
Oct 30 07:22:26.524152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:26.524115    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"]
Oct 30 07:22:26.524644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:26.524316    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" containerID="cri-o://d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631" gracePeriod=30
Oct 30 07:22:31.056902 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.056845    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"]
Oct 30 07:22:31.057320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.057115    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx" podUID="d675742d-3bdc-45da-83e6-4f7afae00b44" containerName="maas-api" containerID="cri-o://3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d" gracePeriod=30
Oct 30 07:22:31.095644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.095601    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:22:31.095770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.095673    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:22:31.460112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.460082    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:22:31.607186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.606183    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs\") pod \"d675742d-3bdc-45da-83e6-4f7afae00b44\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") "
Oct 30 07:22:31.607186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.606276    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s\" (UniqueName: \"kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s\") pod \"d675742d-3bdc-45da-83e6-4f7afae00b44\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") "
Oct 30 07:22:31.607186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.606308    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls\") pod \"d675742d-3bdc-45da-83e6-4f7afae00b44\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") "
Oct 30 07:22:31.607186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.606649    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca\") pod \"d675742d-3bdc-45da-83e6-4f7afae00b44\" (UID: \"d675742d-3bdc-45da-83e6-4f7afae00b44\") "
Oct 30 07:22:31.609963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.609654    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca" pod "d675742d-3bdc-45da-83e6-4f7afae00b44" (UID: "d675742d-3bdc-45da-83e6-4f7afae00b44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:31.611025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.610938    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs" pod "d675742d-3bdc-45da-83e6-4f7afae00b44" (UID: "d675742d-3bdc-45da-83e6-4f7afae00b44"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:31.620364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.615465    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s" pod "d675742d-3bdc-45da-83e6-4f7afae00b44" (UID: "d675742d-3bdc-45da-83e6-4f7afae00b44"). InnerVolumeSpecName "kube-api-access-csl6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:31.622572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.622541    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls" pod "d675742d-3bdc-45da-83e6-4f7afae00b44" (UID: "d675742d-3bdc-45da-83e6-4f7afae00b44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:31.634427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.634381    5073 generic.go:356] "Generic (PLEG): container finished" podID="d675742d-3bdc-45da-83e6-4f7afae00b44" containerID="3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d" exitCode=0
Oct 30 07:22:31.634560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.634431    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"
Oct 30 07:22:31.634635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.634617    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx" event={"ID":"d675742d-3bdc-45da-83e6-4f7afae00b44","Type":"ContainerDied","Data":"3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d"}
Oct 30 07:22:31.634699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.634661    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx" event={"ID":"d675742d-3bdc-45da-83e6-4f7afae00b44","Type":"ContainerDied","Data":"8e4c06db7558c649d6e562a751e2c3fde9b3c0c4210eaf3b4b8393561089a758"}
Oct 30 07:22:31.634699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.634687    5073 scope.go:122] "RemoveContainer" containerID="3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d"
Oct 30 07:22:31.654665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.654635    5073 scope.go:122] "RemoveContainer" containerID="3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d"
Oct 30 07:22:31.655352 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:31.655314    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d\": container with ID starting with 3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d not found: ID does not exist" containerID="3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d"
Oct 30 07:22:31.655478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.655355    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d"} err="failed to get container status \"3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d\": rpc error: code = NotFound desc = could not find container \"3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d\": container with ID starting with 3bdda43fc93b4b8b30ed2e76a88ee145f3f8be4eeec06eceb8578ceb25dbcc8d not found: ID does not exist"
Oct 30 07:22:31.688707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.688445    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"]
Oct 30 07:22:31.693432 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.693403    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-b263d4-848f94996f-wjmvx"]
Oct 30 07:22:31.710932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.710902    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d675742d-3bdc-45da-83e6-4f7afae00b44-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:31.711064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.710933    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:31.711064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.710958    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csl6s\" (UniqueName: \"kubernetes.io/projected/d675742d-3bdc-45da-83e6-4f7afae00b44-kube-api-access-csl6s\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:31.711064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.710973    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d675742d-3bdc-45da-83e6-4f7afae00b44-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:31.795993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.795969    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:22:31.913353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913315    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913369    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913446    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913514    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913555    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913625    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913725    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.913893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913869    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:31.913966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913893    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.914027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.913984    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo\") pod \"d253fe1b-14fc-409c-87c5-1d44d14a2281\" (UID: \"d253fe1b-14fc-409c-87c5-1d44d14a2281\") "
Oct 30 07:22:31.915136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.914578    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:31.915136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.914699    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:31.915136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.914876    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:31.915136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.915033    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:31.915136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.915100    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:31.916027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.915999    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "kube-api-access-6bdgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:31.916524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.916501    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:31.916982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.916950    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:22:31.917266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:31.917249    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token" pod "d253fe1b-14fc-409c-87c5-1d44d14a2281" (UID: "d253fe1b-14fc-409c-87c5-1d44d14a2281"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018402    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018439    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018452    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bdgn\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-kube-api-access-6bdgn\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018465    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018478    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018490    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d253fe1b-14fc-409c-87c5-1d44d14a2281-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018503    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.018924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.018515    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d253fe1b-14fc-409c-87c5-1d44d14a2281-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:32.641989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.641953    5073 generic.go:356] "Generic (PLEG): container finished" podID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerID="d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631" exitCode=0
Oct 30 07:22:32.642444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.642001    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"
Oct 30 07:22:32.642444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.642039    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" event={"ID":"d253fe1b-14fc-409c-87c5-1d44d14a2281","Type":"ContainerDied","Data":"d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631"}
Oct 30 07:22:32.642444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.642103    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll" event={"ID":"d253fe1b-14fc-409c-87c5-1d44d14a2281","Type":"ContainerDied","Data":"30d5dcfb8be3d46877359934230e4a360f778dd1e9638f2cf2245100465fefa9"}
Oct 30 07:22:32.642444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.642135    5073 scope.go:122] "RemoveContainer" containerID="d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631"
Oct 30 07:22:32.652267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.652250    5073 scope.go:122] "RemoveContainer" containerID="d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631"
Oct 30 07:22:32.652534 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:32.652514    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631\": container with ID starting with d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631 not found: ID does not exist" containerID="d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631"
Oct 30 07:22:32.652579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.652544    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631"} err="failed to get container status \"d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631\": rpc error: code = NotFound desc = could not find container \"d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631\": container with ID starting with d7b5fae29463f3b2e3a095d52dd2acf943ba98eafe9db75b27aba0a34726a631 not found: ID does not exist"
Oct 30 07:22:32.707986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.707958    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"]
Oct 30 07:22:32.717348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:32.717321    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-87hll"]
Oct 30 07:22:33.423982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.423951    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" path="/var/lib/kubelet/pods/d253fe1b-14fc-409c-87c5-1d44d14a2281/volumes"
Oct 30 07:22:33.424435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.424421    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d675742d-3bdc-45da-83e6-4f7afae00b44" path="/var/lib/kubelet/pods/d675742d-3bdc-45da-83e6-4f7afae00b44/volumes"
Oct 30 07:22:33.815036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.814950    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"]
Oct 30 07:22:33.817144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817111    5073 cpu_manager.go:414] "containerMap: removing container" podUID="d675742d-3bdc-45da-83e6-4f7afae00b44" containerName="maas-api"
Oct 30 07:22:33.817318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817304    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d675742d-3bdc-45da-83e6-4f7afae00b44" containerName="maas-api"
Oct 30 07:22:33.817502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817490    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy"
Oct 30 07:22:33.817581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817570    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy"
Oct 30 07:22:33.817682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817670    5073 cpu_manager.go:414] "containerMap: removing container" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy"
Oct 30 07:22:33.817763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817753    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy"
Oct 30 07:22:33.817846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817837    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy"
Oct 30 07:22:33.817952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.817940    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy"
Oct 30 07:22:33.818375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.818356    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy"
Oct 30 07:22:33.818478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.818468    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="d253fe1b-14fc-409c-87c5-1d44d14a2281" containerName="istio-proxy"
Oct 30 07:22:33.818559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.818551    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6db2a540-2696-4277-89f3-27012f35f846" containerName="istio-proxy"
Oct 30 07:22:33.818651 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.818642    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="d675742d-3bdc-45da-83e6-4f7afae00b44" containerName="maas-api"
Oct 30 07:22:33.825470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.825422    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:33.854631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.841659    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"]
Oct 30 07:22:33.854631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.848440    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-89664e-serving-cert\""
Oct 30 07:22:33.944374 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.944331    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbls9\" (UniqueName: \"kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:33.944517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.944466    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:33.944619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.944601    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:33.944744 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:33.944723    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.050933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.049362    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.050933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.049520    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.050933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.049580    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbls9\" (UniqueName: \"kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.050933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.049678    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.053249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.052081    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.061895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.058886    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.061895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.059474    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.086680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.085143    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbls9\" (UniqueName: \"kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9\") pod \"maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.156575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.156540    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:34.460010 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:22:34.459977    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813aaad7_d666_4304_99d2_08cda6ed447c.slice/crio-6fc875abceb793ede14ac0e002ce45735b6a108658b809aaef8ee0c2dd09d32e WatchSource:0}: Error finding container 6fc875abceb793ede14ac0e002ce45735b6a108658b809aaef8ee0c2dd09d32e: Status 404 returned error can't find the container with id 6fc875abceb793ede14ac0e002ce45735b6a108658b809aaef8ee0c2dd09d32e
Oct 30 07:22:34.460348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.460323    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"]
Oct 30 07:22:34.660590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:34.660551    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4" event={"ID":"813aaad7-d666-4304-99d2-08cda6ed447c","Type":"ContainerStarted","Data":"6fc875abceb793ede14ac0e002ce45735b6a108658b809aaef8ee0c2dd09d32e"}
Oct 30 07:22:35.670290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:35.670256    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4" event={"ID":"813aaad7-d666-4304-99d2-08cda6ed447c","Type":"ContainerStarted","Data":"74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24"}
Oct 30 07:22:35.670755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:35.670328    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:35.717952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:35.717269    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4" podStartSLOduration=2.404867225 podStartE2EDuration="2.717249336s" totalImagesPullingTime="312.382111ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:22:35.714903694 +0000 UTC m=+1558.422783863" watchObservedRunningTime="2026-10-30 07:22:35.717249336 +0000 UTC m=+1558.425129507"
Oct 30 07:22:41.682780 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:41.682749    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:22:43.927219 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:43.927179    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:22:52.397374 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:52.397296    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"]
Oct 30 07:22:52.397946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:52.397497    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy" containerID="cri-o://3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331" gracePeriod=30
Oct 30 07:22:53.406908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.406874    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"]
Oct 30 07:22:53.407354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.407118    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" podUID="2cdeeda2-4c8c-484c-874d-1bf5583f67ff" containerName="maas-api" containerID="cri-o://e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7" gracePeriod=30
Oct 30 07:22:53.725987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.725954    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:22:53.792925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.792884    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz\" (UniqueName: \"kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz\") pod \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") "
Oct 30 07:22:53.793141 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.792941    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\") pod \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") "
Oct 30 07:22:53.793211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.793175    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs\") pod \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") "
Oct 30 07:22:53.793271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.793226    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca\") pod \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\" (UID: \"2cdeeda2-4c8c-484c-874d-1bf5583f67ff\") "
Oct 30 07:22:53.794352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.794321    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca" pod "2cdeeda2-4c8c-484c-874d-1bf5583f67ff" (UID: "2cdeeda2-4c8c-484c-874d-1bf5583f67ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:53.819895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.806074    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs" pod "2cdeeda2-4c8c-484c-874d-1bf5583f67ff" (UID: "2cdeeda2-4c8c-484c-874d-1bf5583f67ff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:53.822013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.821597    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls" pod "2cdeeda2-4c8c-484c-874d-1bf5583f67ff" (UID: "2cdeeda2-4c8c-484c-874d-1bf5583f67ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:53.832626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.832591    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz" pod "2cdeeda2-4c8c-484c-874d-1bf5583f67ff" (UID: "2cdeeda2-4c8c-484c-874d-1bf5583f67ff"). InnerVolumeSpecName "kube-api-access-lsxxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:53.838019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.837988    5073 generic.go:356] "Generic (PLEG): container finished" podID="2cdeeda2-4c8c-484c-874d-1bf5583f67ff" containerID="e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7" exitCode=0
Oct 30 07:22:53.838137 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.838052    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"
Oct 30 07:22:53.838202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.838182    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" event={"ID":"2cdeeda2-4c8c-484c-874d-1bf5583f67ff","Type":"ContainerDied","Data":"e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7"}
Oct 30 07:22:53.838268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.838238    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj" event={"ID":"2cdeeda2-4c8c-484c-874d-1bf5583f67ff","Type":"ContainerDied","Data":"395129fb549d2e94ac919f0ebd1556a47a89baa30f4283a5fe3152f6a677fc5e"}
Oct 30 07:22:53.838316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.838269    5073 scope.go:122] "RemoveContainer" containerID="e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7"
Oct 30 07:22:53.854064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.853984    5073 scope.go:122] "RemoveContainer" containerID="e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7"
Oct 30 07:22:53.854432 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:53.854406    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7\": container with ID starting with e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7 not found: ID does not exist" containerID="e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7"
Oct 30 07:22:53.854513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.854442    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7"} err="failed to get container status \"e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7\": rpc error: code = NotFound desc = could not find container \"e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7\": container with ID starting with e916d16eb6c106765e7a702fe7fe71eebf85d4288a0cca6f1609f9811cf061e7 not found: ID does not exist"
Oct 30 07:22:53.893758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.893706    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"]
Oct 30 07:22:53.895110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.895026    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:53.895110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.895057    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:53.895110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.895074    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsxxz\" (UniqueName: \"kubernetes.io/projected/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-kube-api-access-lsxxz\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:53.895110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.895088    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cdeeda2-4c8c-484c-874d-1bf5583f67ff-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:53.903932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:53.903895    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-704bf6-585f68ffd8-pz2tj"]
Oct 30 07:22:55.425257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:55.425215    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2cdeeda2-4c8c-484c-874d-1bf5583f67ff" path="/var/lib/kubelet/pods/2cdeeda2-4c8c-484c-874d-1bf5583f67ff/volumes"
Oct 30 07:22:57.677614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.677554    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:22:57.771233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771197    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771311    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771374    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771414    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771443    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771539    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771616    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771683    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.771966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.771803    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn\") pod \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\" (UID: \"39fb21ec-bc5a-495d-84c6-29a4b7f74541\") "
Oct 30 07:22:57.772840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.772462    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:57.772840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.772563    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.773127 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.773058    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:57.773499 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.773309    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:57.773885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.773846    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:57.774325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.774305    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:57.777716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.777689    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "kube-api-access-d8jtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:57.778443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.778408    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:22:57.778690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.778658    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:57.779310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.779290    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy" pod "39fb21ec-bc5a-495d-84c6-29a4b7f74541" (UID: "39fb21ec-bc5a-495d-84c6-29a4b7f74541"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:22:57.868237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.868197    5073 generic.go:356] "Generic (PLEG): container finished" podID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerID="3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331" exitCode=0
Oct 30 07:22:57.868424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.868248    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"
Oct 30 07:22:57.868424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.868266    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" event={"ID":"39fb21ec-bc5a-495d-84c6-29a4b7f74541","Type":"ContainerDied","Data":"3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331"}
Oct 30 07:22:57.868424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.868318    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb" event={"ID":"39fb21ec-bc5a-495d-84c6-29a4b7f74541","Type":"ContainerDied","Data":"b45ac0480dd3d4f6b7dcd2eb64343de17fee5913866af0dcbe73654cfe17664f"}
Oct 30 07:22:57.868424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.868350    5073 scope.go:122] "RemoveContainer" containerID="3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331"
Oct 30 07:22:57.873917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873876    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.873917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873909    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.874088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873924    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.874088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873940    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.874088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873957    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.874088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873970    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.874088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873984    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8jtn\" (UniqueName: \"kubernetes.io/projected/39fb21ec-bc5a-495d-84c6-29a4b7f74541-kube-api-access-d8jtn\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.874088 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.873998    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39fb21ec-bc5a-495d-84c6-29a4b7f74541-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:57.884885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.884515    5073 scope.go:122] "RemoveContainer" containerID="3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331"
Oct 30 07:22:57.884885 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:57.884836    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331\": container with ID starting with 3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331 not found: ID does not exist" containerID="3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331"
Oct 30 07:22:57.884885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.884878    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331"} err="failed to get container status \"3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331\": rpc error: code = NotFound desc = could not find container \"3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331\": container with ID starting with 3a3097bd34a847f7ea07dbe08b6fe078aea35538597a8d1ceaf7ebeec5592331 not found: ID does not exist"
Oct 30 07:22:57.920004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.919968    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"]
Oct 30 07:22:57.925049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.925019    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-pgpxb"]
Oct 30 07:22:57.983510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.983422    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"]
Oct 30 07:22:57.983692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:57.983645    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9" podUID="2e866e08-76dc-49da-90c1-ac0ca6334717" containerName="maas-api" containerID="cri-o://c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013" gracePeriod=30
Oct 30 07:22:58.274836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.273694    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:22:58.387666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.387634    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk\" (UniqueName: \"kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk\") pod \"2e866e08-76dc-49da-90c1-ac0ca6334717\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") "
Oct 30 07:22:58.387883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.387677    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs\") pod \"2e866e08-76dc-49da-90c1-ac0ca6334717\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") "
Oct 30 07:22:58.387883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.387749    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca\") pod \"2e866e08-76dc-49da-90c1-ac0ca6334717\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") "
Oct 30 07:22:58.388012 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.387917    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls\") pod \"2e866e08-76dc-49da-90c1-ac0ca6334717\" (UID: \"2e866e08-76dc-49da-90c1-ac0ca6334717\") "
Oct 30 07:22:58.388538 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.388506    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca" pod "2e866e08-76dc-49da-90c1-ac0ca6334717" (UID: "2e866e08-76dc-49da-90c1-ac0ca6334717"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:58.390707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.390683    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk" pod "2e866e08-76dc-49da-90c1-ac0ca6334717" (UID: "2e866e08-76dc-49da-90c1-ac0ca6334717"). InnerVolumeSpecName "kube-api-access-z2crk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:58.390987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.390966    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls" pod "2e866e08-76dc-49da-90c1-ac0ca6334717" (UID: "2e866e08-76dc-49da-90c1-ac0ca6334717"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:58.391287 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.391262    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs" pod "2e866e08-76dc-49da-90c1-ac0ca6334717" (UID: "2e866e08-76dc-49da-90c1-ac0ca6334717"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:58.425199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.425170    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"]
Oct 30 07:22:58.425402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.425379    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" podUID="fcadfd42-0b84-4c73-bf7e-6ef9ec075768" containerName="maas-api" containerID="cri-o://2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc" gracePeriod=30
Oct 30 07:22:58.492418 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.492382    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e866e08-76dc-49da-90c1-ac0ca6334717-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:58.492418 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.492418    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:58.492657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.492433    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2crk\" (UniqueName: \"kubernetes.io/projected/2e866e08-76dc-49da-90c1-ac0ca6334717-kube-api-access-z2crk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:58.492657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.492448    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e866e08-76dc-49da-90c1-ac0ca6334717-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:58.760947 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.759171    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:22:58.895992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.895915    5073 generic.go:356] "Generic (PLEG): container finished" podID="2e866e08-76dc-49da-90c1-ac0ca6334717" containerID="c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013" exitCode=0
Oct 30 07:22:58.895992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.895969    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"
Oct 30 07:22:58.896273 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.896120    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9" event={"ID":"2e866e08-76dc-49da-90c1-ac0ca6334717","Type":"ContainerDied","Data":"c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013"}
Oct 30 07:22:58.896273 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.896170    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9" event={"ID":"2e866e08-76dc-49da-90c1-ac0ca6334717","Type":"ContainerDied","Data":"1cc2c46ff7c9b8958e90b64385e789232d0b64766edbe410070c3465af657766"}
Oct 30 07:22:58.896273 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.896202    5073 scope.go:122] "RemoveContainer" containerID="c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013"
Oct 30 07:22:58.901580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.901265    5073 generic.go:356] "Generic (PLEG): container finished" podID="fcadfd42-0b84-4c73-bf7e-6ef9ec075768" containerID="2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc" exitCode=0
Oct 30 07:22:58.901580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.901336    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" event={"ID":"fcadfd42-0b84-4c73-bf7e-6ef9ec075768","Type":"ContainerDied","Data":"2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc"}
Oct 30 07:22:58.901580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.901373    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9" event={"ID":"fcadfd42-0b84-4c73-bf7e-6ef9ec075768","Type":"ContainerDied","Data":"e1052ccc19429d8130263df551fad4cd686153c9a18e878723265beb18198d24"}
Oct 30 07:22:58.901580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.901442    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"
Oct 30 07:22:58.911815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.911792    5073 scope.go:122] "RemoveContainer" containerID="c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013"
Oct 30 07:22:58.912134 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:58.912112    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013\": container with ID starting with c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013 not found: ID does not exist" containerID="c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013"
Oct 30 07:22:58.912222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.912145    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013"} err="failed to get container status \"c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013\": rpc error: code = NotFound desc = could not find container \"c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013\": container with ID starting with c0c7866d06e45cc14c93b415322a02fe2b11ff7a7e73a560d187c037b4404013 not found: ID does not exist"
Oct 30 07:22:58.912222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.912171    5073 scope.go:122] "RemoveContainer" containerID="2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc"
Oct 30 07:22:58.914826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.914802    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs\") pod \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") "
Oct 30 07:22:58.914952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.914888    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca\") pod \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") "
Oct 30 07:22:58.915011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.914951    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\") pod \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") "
Oct 30 07:22:58.915171 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.915155    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82\" (UniqueName: \"kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82\") pod \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\" (UID: \"fcadfd42-0b84-4c73-bf7e-6ef9ec075768\") "
Oct 30 07:22:58.915433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.915392    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca" pod "fcadfd42-0b84-4c73-bf7e-6ef9ec075768" (UID: "fcadfd42-0b84-4c73-bf7e-6ef9ec075768"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:22:58.915906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.915885    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:58.917557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.917521    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs" pod "fcadfd42-0b84-4c73-bf7e-6ef9ec075768" (UID: "fcadfd42-0b84-4c73-bf7e-6ef9ec075768"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:58.918155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.918131    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls" pod "fcadfd42-0b84-4c73-bf7e-6ef9ec075768" (UID: "fcadfd42-0b84-4c73-bf7e-6ef9ec075768"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:22:58.918236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.918150    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82" pod "fcadfd42-0b84-4c73-bf7e-6ef9ec075768" (UID: "fcadfd42-0b84-4c73-bf7e-6ef9ec075768"). InnerVolumeSpecName "kube-api-access-mpw82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:22:58.951205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.951174    5073 scope.go:122] "RemoveContainer" containerID="2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc"
Oct 30 07:22:58.951589 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:22:58.951567    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc\": container with ID starting with 2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc not found: ID does not exist" containerID="2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc"
Oct 30 07:22:58.951674 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.951600    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc"} err="failed to get container status \"2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc\": rpc error: code = NotFound desc = could not find container \"2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc\": container with ID starting with 2319fa2cb4155def3ab8d551c78320d36149ab5d7e0c2d76ba13787e144c41fc not found: ID does not exist"
Oct 30 07:22:58.990995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.990213    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"]
Oct 30 07:22:58.990995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:58.990634    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-2504c2-6867975dc4-kkdm9"]
Oct 30 07:22:59.027874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.026555    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpw82\" (UniqueName: \"kubernetes.io/projected/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-kube-api-access-mpw82\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:59.027874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.026587    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:59.027874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.026597    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadfd42-0b84-4c73-bf7e-6ef9ec075768-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:22:59.254199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.254159    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"]
Oct 30 07:22:59.258400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.258369    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-a51baa-644696779c-qlcv9"]
Oct 30 07:22:59.436299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.436264    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e866e08-76dc-49da-90c1-ac0ca6334717" path="/var/lib/kubelet/pods/2e866e08-76dc-49da-90c1-ac0ca6334717/volumes"
Oct 30 07:22:59.437155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.437123    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" path="/var/lib/kubelet/pods/39fb21ec-bc5a-495d-84c6-29a4b7f74541/volumes"
Oct 30 07:22:59.438826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:22:59.437781    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fcadfd42-0b84-4c73-bf7e-6ef9ec075768" path="/var/lib/kubelet/pods/fcadfd42-0b84-4c73-bf7e-6ef9ec075768/volumes"
Oct 30 07:23:02.180904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:02.176758    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"]
Oct 30 07:23:02.180904 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:02.177066    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" containerID="cri-o://72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519" gracePeriod=30
Oct 30 07:23:04.165684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:04.165635    5073 patch_prober.go:29] interesting pod/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:23:04.166107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:04.165716    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:23:07.466636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.466572    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:23:07.588191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588144    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588228    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588264    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588327    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588394    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588421    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588495    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588708    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.588923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.588743    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo\") pod \"47ca7c2a-306f-4276-817e-80af65dd8f30\" (UID: \"47ca7c2a-306f-4276-817e-80af65dd8f30\") "
Oct 30 07:23:07.590283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.590253    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:07.590773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.590740    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:07.591078 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.591054    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:07.591985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.591748    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:23:07.592182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.592133    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:07.594514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.594489    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:07.596288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.596253    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "kube-api-access-69b2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:07.596288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.596260    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:23:07.612470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.612439    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy" pod "47ca7c2a-306f-4276-817e-80af65dd8f30" (UID: "47ca7c2a-306f-4276-817e-80af65dd8f30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:07.690790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690750    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.690790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690784    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69b2d\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-kube-api-access-69b2d\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.690790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690795    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca7c2a-306f-4276-817e-80af65dd8f30-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.691107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690805    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.691107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690813    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.691107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690821    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca7c2a-306f-4276-817e-80af65dd8f30-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.691107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690829    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.691107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690837    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.691107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.690845    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca7c2a-306f-4276-817e-80af65dd8f30-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:07.987933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.987892    5073 generic.go:356] "Generic (PLEG): container finished" podID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerID="72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519" exitCode=0
Oct 30 07:23:07.988159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.987954    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"
Oct 30 07:23:07.988159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.987971    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" event={"ID":"47ca7c2a-306f-4276-817e-80af65dd8f30","Type":"ContainerDied","Data":"72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519"}
Oct 30 07:23:07.988159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.988037    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb" event={"ID":"47ca7c2a-306f-4276-817e-80af65dd8f30","Type":"ContainerDied","Data":"b9ca6fb98100ecb0071b33c0fee0c47fbd5822beb48dbc5b4897e5505a963672"}
Oct 30 07:23:07.988159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.988069    5073 scope.go:122] "RemoveContainer" containerID="72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519"
Oct 30 07:23:07.999515 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.999499    5073 scope.go:122] "RemoveContainer" containerID="72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519"
Oct 30 07:23:07.999895 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:07.999828    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519\": container with ID starting with 72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519 not found: ID does not exist" containerID="72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519"
Oct 30 07:23:07.999999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:07.999898    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519"} err="failed to get container status \"72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519\": rpc error: code = NotFound desc = could not find container \"72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519\": container with ID starting with 72eec626bd275286e592c17f43fcc56e1d8faed09359f0a8780cf496562f5519 not found: ID does not exist"
Oct 30 07:23:08.050367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:08.050338    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"]
Oct 30 07:23:08.056182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:08.056152    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-b-704bf6-openshift-default-7b79bc878f-p2jlb"]
Oct 30 07:23:09.425353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:09.425310    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" path="/var/lib/kubelet/pods/47ca7c2a-306f-4276-817e-80af65dd8f30/volumes"
Oct 30 07:23:13.941889 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:13.935029    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:23:18.764524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.764486    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"]
Oct 30 07:23:18.765166 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765150    5073 cpu_manager.go:414] "containerMap: removing container" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy"
Oct 30 07:23:18.765235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765167    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy"
Oct 30 07:23:18.765235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765190    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fcadfd42-0b84-4c73-bf7e-6ef9ec075768" containerName="maas-api"
Oct 30 07:23:18.765235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765196    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fcadfd42-0b84-4c73-bf7e-6ef9ec075768" containerName="maas-api"
Oct 30 07:23:18.765235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765204    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2cdeeda2-4c8c-484c-874d-1bf5583f67ff" containerName="maas-api"
Oct 30 07:23:18.765235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765208    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2cdeeda2-4c8c-484c-874d-1bf5583f67ff" containerName="maas-api"
Oct 30 07:23:18.765235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765234    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2e866e08-76dc-49da-90c1-ac0ca6334717" containerName="maas-api"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765238    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e866e08-76dc-49da-90c1-ac0ca6334717" containerName="maas-api"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765248    5073 cpu_manager.go:414] "containerMap: removing container" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765253    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765340    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e866e08-76dc-49da-90c1-ac0ca6334717" containerName="maas-api"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765351    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="47ca7c2a-306f-4276-817e-80af65dd8f30" containerName="istio-proxy"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765365    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="39fb21ec-bc5a-495d-84c6-29a4b7f74541" containerName="istio-proxy"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765375    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fcadfd42-0b84-4c73-bf7e-6ef9ec075768" containerName="maas-api"
Oct 30 07:23:18.765414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.765381    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2cdeeda2-4c8c-484c-874d-1bf5583f67ff" containerName="maas-api"
Oct 30 07:23:18.771073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.771052    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.785021 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.784993    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-a-a51baa-openshift-default-dockercfg-gh6wr\""
Oct 30 07:23:18.800314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.800291    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"]
Oct 30 07:23:18.836609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.836572    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.836754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.836734    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.836842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.836804    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.836929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.836843    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjkbk\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.836988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.836967    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.837044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.836990    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.837044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.837038    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.837146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.837070    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.837146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.837100    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937775 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937742    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937800    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937828    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjkbk\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937875    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937902    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937927    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.937969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937957    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.937983    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.938045    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.938185    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.938220    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.938315    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.938493    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.938802 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.938778    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.940362 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.940331    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.940595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.940575    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.960659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.960632    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjkbk\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:18.961597 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:18.961568    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token\") pod \"e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") " pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:19.085309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:19.085220    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:19.411278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:19.411247    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"]
Oct 30 07:23:19.411802 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:23:19.411773    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b96d4f3_05e6_4b83_b1fc_5cdec9c5d8db.slice/crio-718f02f3145dfb35021896d38022b7d1b5f39d43b2618e9c327a68938f8b9fcd WatchSource:0}: Error finding container 718f02f3145dfb35021896d38022b7d1b5f39d43b2618e9c327a68938f8b9fcd: Status 404 returned error can't find the container with id 718f02f3145dfb35021896d38022b7d1b5f39d43b2618e9c327a68938f8b9fcd
Oct 30 07:23:19.414538 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:19.414506    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:23:19.414611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:19.414566    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:23:19.414611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:19.414594    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:23:20.123050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:20.123012    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" event={"ID":"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db","Type":"ContainerStarted","Data":"cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8"}
Oct 30 07:23:20.123456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:20.123078    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" event={"ID":"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db","Type":"ContainerStarted","Data":"718f02f3145dfb35021896d38022b7d1b5f39d43b2618e9c327a68938f8b9fcd"}
Oct 30 07:23:20.198876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:20.198431    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podStartSLOduration=2.198412781 podStartE2EDuration="2.198412781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:23:20.18544169 +0000 UTC m=+1602.893321860" watchObservedRunningTime="2026-10-30 07:23:20.198412781 +0000 UTC m=+1602.906292950"
Oct 30 07:23:21.090658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:21.090621    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:21.096874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:21.092951    5073 patch_prober.go:29] interesting pod/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 07:23:21.096874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:21.093008    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 07:23:22.088691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:22.088202    5073 patch_prober.go:29] interesting pod/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 07:23:22.088691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:22.088269    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 07:23:23.101966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:23.101931    5073 patch_prober.go:29] interesting pod/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 07:23:23.103104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:23.102620    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 07:23:24.092877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:24.092433    5073 patch_prober.go:29] interesting pod/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 07:23:24.092877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:24.092492    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 07:23:25.087227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:25.087189    5073 patch_prober.go:29] interesting pod/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 07:23:25.087820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:25.087790    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 07:23:26.091199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:26.091165    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:26.091705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:26.091646    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:26.092382 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:26.092362    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:31.340173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:31.340138    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"]
Oct 30 07:23:31.340687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:31.340392    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy" containerID="cri-o://72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46" gracePeriod=30
Oct 30 07:23:36.076206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.076169    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"]
Oct 30 07:23:36.076656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.076463    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" podUID="8448edb3-57f8-45a4-a2bd-c35580797999" containerName="maas-api" containerID="cri-o://72bd7d3b6abb46da2ba40acd4dab74dafbe072a3f05221b186553e3a73a5c43e" gracePeriod=30
Oct 30 07:23:36.270212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.269970    5073 generic.go:356] "Generic (PLEG): container finished" podID="8448edb3-57f8-45a4-a2bd-c35580797999" containerID="72bd7d3b6abb46da2ba40acd4dab74dafbe072a3f05221b186553e3a73a5c43e" exitCode=0
Oct 30 07:23:36.270212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.270034    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" event={"ID":"8448edb3-57f8-45a4-a2bd-c35580797999","Type":"ContainerDied","Data":"72bd7d3b6abb46da2ba40acd4dab74dafbe072a3f05221b186553e3a73a5c43e"}
Oct 30 07:23:36.503696 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.503668    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:23:36.691150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.691055    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls\") pod \"8448edb3-57f8-45a4-a2bd-c35580797999\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") "
Oct 30 07:23:36.691340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.691262    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca\") pod \"8448edb3-57f8-45a4-a2bd-c35580797999\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") "
Oct 30 07:23:36.691340 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.691296    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs\") pod \"8448edb3-57f8-45a4-a2bd-c35580797999\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") "
Oct 30 07:23:36.691470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.691407    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b\" (UniqueName: \"kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b\") pod \"8448edb3-57f8-45a4-a2bd-c35580797999\" (UID: \"8448edb3-57f8-45a4-a2bd-c35580797999\") "
Oct 30 07:23:36.692022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.691981    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca" pod "8448edb3-57f8-45a4-a2bd-c35580797999" (UID: "8448edb3-57f8-45a4-a2bd-c35580797999"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:23:36.694334 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.694298    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls" pod "8448edb3-57f8-45a4-a2bd-c35580797999" (UID: "8448edb3-57f8-45a4-a2bd-c35580797999"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:23:36.694559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.694524    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs" pod "8448edb3-57f8-45a4-a2bd-c35580797999" (UID: "8448edb3-57f8-45a4-a2bd-c35580797999"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:23:36.694708 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.694674    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b" pod "8448edb3-57f8-45a4-a2bd-c35580797999" (UID: "8448edb3-57f8-45a4-a2bd-c35580797999"). InnerVolumeSpecName "kube-api-access-47d4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:36.748431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.748406    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:23:36.792542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792513    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.792714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792596    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.792714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792631    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.792714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792699    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.792893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792840    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.792959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792914    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.793014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792985    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.793014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.792986    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:36.793116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793019    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.793116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793071    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs\") pod \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\" (UID: \"63cb7d10-6130-42c2-b848-69f5b77e8fd9\") "
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793301    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793521    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793577    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793752    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8448edb3-57f8-45a4-a2bd-c35580797999-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793777    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793792    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793806    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47d4b\" (UniqueName: \"kubernetes.io/projected/8448edb3-57f8-45a4-a2bd-c35580797999-kube-api-access-47d4b\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793819    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793833    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793846    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8448edb3-57f8-45a4-a2bd-c35580797999-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793888    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.793970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.793936    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:36.795600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.795572    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:36.798114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.798090    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "kube-api-access-9btzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:36.798309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.798274    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:36.800091 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.800068    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo" pod "63cb7d10-6130-42c2-b848-69f5b77e8fd9" (UID: "63cb7d10-6130-42c2-b848-69f5b77e8fd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:23:36.895475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.895441    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.895475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.895471    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.895475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.895482    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cb7d10-6130-42c2-b848-69f5b77e8fd9-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.895692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.895492    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9btzk\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-kube-api-access-9btzk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:36.895692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:36.895501    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cb7d10-6130-42c2-b848-69f5b77e8fd9-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:37.282867 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.282812    5073 generic.go:356] "Generic (PLEG): container finished" podID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerID="72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46" exitCode=0
Oct 30 07:23:37.283397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.282899    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"
Oct 30 07:23:37.283397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.282916    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" event={"ID":"63cb7d10-6130-42c2-b848-69f5b77e8fd9","Type":"ContainerDied","Data":"72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46"}
Oct 30 07:23:37.283397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.282975    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br" event={"ID":"63cb7d10-6130-42c2-b848-69f5b77e8fd9","Type":"ContainerDied","Data":"96f3aef35e0c72f4104da64eb0434ecfeb51abf26cc0d57556619c0d75b0f57b"}
Oct 30 07:23:37.283397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.283003    5073 scope.go:122] "RemoveContainer" containerID="72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46"
Oct 30 07:23:37.284815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.284790    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" event={"ID":"8448edb3-57f8-45a4-a2bd-c35580797999","Type":"ContainerDied","Data":"ae8bf4abc396b27bb5c1c6c6e89ead8385627237d33df2a1397cecea5441a4a0"}
Oct 30 07:23:37.284815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.284804    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"
Oct 30 07:23:37.297672 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.297651    5073 scope.go:122] "RemoveContainer" containerID="72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46"
Oct 30 07:23:37.297968 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:37.297941    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46\": container with ID starting with 72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46 not found: ID does not exist" containerID="72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46"
Oct 30 07:23:37.298043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.297979    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46"} err="failed to get container status \"72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46\": rpc error: code = NotFound desc = could not find container \"72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46\": container with ID starting with 72d583c09c2380a739a1667ab41ec127a92b3abeb9e8b0d15e41976ce84f9c46 not found: ID does not exist"
Oct 30 07:23:37.298043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.298002    5073 scope.go:122] "RemoveContainer" containerID="72bd7d3b6abb46da2ba40acd4dab74dafbe072a3f05221b186553e3a73a5c43e"
Oct 30 07:23:37.335005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.334813    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"]
Oct 30 07:23:37.337792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.337769    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt"]
Oct 30 07:23:37.373127 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.373097    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"]
Oct 30 07:23:37.378283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.378226    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-hd2br"]
Oct 30 07:23:37.425900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.424463    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" path="/var/lib/kubelet/pods/63cb7d10-6130-42c2-b848-69f5b77e8fd9/volumes"
Oct 30 07:23:37.425900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:37.425072    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8448edb3-57f8-45a4-a2bd-c35580797999" path="/var/lib/kubelet/pods/8448edb3-57f8-45a4-a2bd-c35580797999/volumes"
Oct 30 07:23:39.441734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:39.441691    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-411c9d-cf9b46959-kpwgt" podUID="8448edb3-57f8-45a4-a2bd-c35580797999" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.124:8443/health\": context deadline exceeded"
Oct 30 07:23:43.922928 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:43.922829    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:23:49.660657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:49.660620    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"]
Oct 30 07:23:49.661349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:49.661316    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy" containerID="cri-o://cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8" gracePeriod=30
Oct 30 07:23:54.969786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:54.969724    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:55.105389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105350    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105408    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105474    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105535    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105554    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105647    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105685    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105716    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.105827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.105732    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy\") pod \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\" (UID: \"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db\") "
Oct 30 07:23:55.106687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.106659    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:55.107074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.107056    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:55.107190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.107124    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:23:55.107350 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.107330    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:55.107793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.107769    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:55.109762 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.109738    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:23:55.110395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.110374    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:23:55.110513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.110407    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:55.110513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.110495    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk" pod "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" (UID: "7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db"). InnerVolumeSpecName "kube-api-access-mjkbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:55.207525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207487    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207525    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207538    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207550    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207563    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207574    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207584    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207594    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjkbk\" (UniqueName: \"kubernetes.io/projected/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-kube-api-access-mjkbk\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.207752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.207607    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:55.431351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.431317    5073 generic.go:356] "Generic (PLEG): container finished" podID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerID="cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8" exitCode=0
Oct 30 07:23:55.431533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.431376    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"
Oct 30 07:23:55.431533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.431399    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" event={"ID":"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db","Type":"ContainerDied","Data":"cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8"}
Oct 30 07:23:55.431533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.431453    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7" event={"ID":"7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db","Type":"ContainerDied","Data":"718f02f3145dfb35021896d38022b7d1b5f39d43b2618e9c327a68938f8b9fcd"}
Oct 30 07:23:55.431533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.431484    5073 scope.go:122] "RemoveContainer" containerID="cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8"
Oct 30 07:23:55.441982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.441964    5073 scope.go:122] "RemoveContainer" containerID="cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8"
Oct 30 07:23:55.442220 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:55.442200    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8\": container with ID starting with cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8 not found: ID does not exist" containerID="cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8"
Oct 30 07:23:55.442275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.442228    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8"} err="failed to get container status \"cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8\": rpc error: code = NotFound desc = could not find container \"cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8\": container with ID starting with cacfc0d7d9857f30734f78d3afebcd983510f49f08da5cafb63eadc4b46c90b8 not found: ID does not exist"
Oct 30 07:23:55.487043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.486994    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"]
Oct 30 07:23:55.497134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.497100    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-a-a51baa-openshift-default-65b9d7cc89-h8zn7"]
Oct 30 07:23:55.716198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.716116    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"]
Oct 30 07:23:55.716377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:55.716324    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" podUID="4bcf9265-2ef3-46db-a90c-a656fb09a138" containerName="maas-api" containerID="cri-o://90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f" gracePeriod=30
Oct 30 07:23:56.041042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.041011    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:23:56.124506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.124470    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v\" (UniqueName: \"kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v\") pod \"4bcf9265-2ef3-46db-a90c-a656fb09a138\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") "
Oct 30 07:23:56.124721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.124548    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\") pod \"4bcf9265-2ef3-46db-a90c-a656fb09a138\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") "
Oct 30 07:23:56.124721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.124618    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs\") pod \"4bcf9265-2ef3-46db-a90c-a656fb09a138\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") "
Oct 30 07:23:56.124889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.124719    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca\") pod \"4bcf9265-2ef3-46db-a90c-a656fb09a138\" (UID: \"4bcf9265-2ef3-46db-a90c-a656fb09a138\") "
Oct 30 07:23:56.125422 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.125393    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca" pod "4bcf9265-2ef3-46db-a90c-a656fb09a138" (UID: "4bcf9265-2ef3-46db-a90c-a656fb09a138"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:23:56.127411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.127388    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v" pod "4bcf9265-2ef3-46db-a90c-a656fb09a138" (UID: "4bcf9265-2ef3-46db-a90c-a656fb09a138"). InnerVolumeSpecName "kube-api-access-sgw6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:56.127507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.127432    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls" pod "4bcf9265-2ef3-46db-a90c-a656fb09a138" (UID: "4bcf9265-2ef3-46db-a90c-a656fb09a138"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:23:56.129016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.128990    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs" pod "4bcf9265-2ef3-46db-a90c-a656fb09a138" (UID: "4bcf9265-2ef3-46db-a90c-a656fb09a138"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:23:56.227271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.227196    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgw6v\" (UniqueName: \"kubernetes.io/projected/4bcf9265-2ef3-46db-a90c-a656fb09a138-kube-api-access-sgw6v\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:56.227271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.227230    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:56.227271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.227239    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bcf9265-2ef3-46db-a90c-a656fb09a138-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:56.227271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.227248    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bcf9265-2ef3-46db-a90c-a656fb09a138-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:56.439792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.439751    5073 generic.go:356] "Generic (PLEG): container finished" podID="4bcf9265-2ef3-46db-a90c-a656fb09a138" containerID="90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f" exitCode=0
Oct 30 07:23:56.439996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.439800    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"
Oct 30 07:23:56.439996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.439837    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" event={"ID":"4bcf9265-2ef3-46db-a90c-a656fb09a138","Type":"ContainerDied","Data":"90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f"}
Oct 30 07:23:56.439996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.439907    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj" event={"ID":"4bcf9265-2ef3-46db-a90c-a656fb09a138","Type":"ContainerDied","Data":"a4891cb92a6e2050709d374e3bb3620db992ed462396c50249df4d13026f8e84"}
Oct 30 07:23:56.439996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.439934    5073 scope.go:122] "RemoveContainer" containerID="90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f"
Oct 30 07:23:56.450649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.450630    5073 scope.go:122] "RemoveContainer" containerID="90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f"
Oct 30 07:23:56.450922 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:56.450902    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f\": container with ID starting with 90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f not found: ID does not exist" containerID="90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f"
Oct 30 07:23:56.450975 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.450932    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f"} err="failed to get container status \"90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f\": rpc error: code = NotFound desc = could not find container \"90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f\": container with ID starting with 90015140fd00a2ac73d00328dac6ffc0e9258ceae085ee24225a7ccbe829df4f not found: ID does not exist"
Oct 30 07:23:56.492139 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.492062    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"]
Oct 30 07:23:56.503265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:56.503233    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-45b148-546db8cb5b-nlcfj"]
Oct 30 07:23:57.424704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:57.424673    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4bcf9265-2ef3-46db-a90c-a656fb09a138" path="/var/lib/kubelet/pods/4bcf9265-2ef3-46db-a90c-a656fb09a138/volumes"
Oct 30 07:23:57.425209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:57.425194    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" path="/var/lib/kubelet/pods/7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db/volumes"
Oct 30 07:23:58.566167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:58.566128    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"]
Oct 30 07:23:58.566646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:58.566370    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6" podUID="972cf62c-016d-458c-ad59-663c1a881e81" containerName="maas-api" containerID="cri-o://9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96" gracePeriod=30
Oct 30 07:23:58.880380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:58.880342    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:23:59.069729 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.069701    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls\") pod \"972cf62c-016d-458c-ad59-663c1a881e81\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") "
Oct 30 07:23:59.069919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.069790    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca\") pod \"972cf62c-016d-458c-ad59-663c1a881e81\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") "
Oct 30 07:23:59.069986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.069932    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7\" (UniqueName: \"kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7\") pod \"972cf62c-016d-458c-ad59-663c1a881e81\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") "
Oct 30 07:23:59.070056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.070039    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs\") pod \"972cf62c-016d-458c-ad59-663c1a881e81\" (UID: \"972cf62c-016d-458c-ad59-663c1a881e81\") "
Oct 30 07:23:59.070179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.070150    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca" pod "972cf62c-016d-458c-ad59-663c1a881e81" (UID: "972cf62c-016d-458c-ad59-663c1a881e81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:23:59.070485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.070464    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cf62c-016d-458c-ad59-663c1a881e81-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:59.071801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.071775    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls" pod "972cf62c-016d-458c-ad59-663c1a881e81" (UID: "972cf62c-016d-458c-ad59-663c1a881e81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:23:59.072078 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.072053    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7" pod "972cf62c-016d-458c-ad59-663c1a881e81" (UID: "972cf62c-016d-458c-ad59-663c1a881e81"). InnerVolumeSpecName "kube-api-access-mxqr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:23:59.072257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.072238    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs" pod "972cf62c-016d-458c-ad59-663c1a881e81" (UID: "972cf62c-016d-458c-ad59-663c1a881e81"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:23:59.175844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.175803    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:59.176069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.175846    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxqr7\" (UniqueName: \"kubernetes.io/projected/972cf62c-016d-458c-ad59-663c1a881e81-kube-api-access-mxqr7\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:59.176069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.175909    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/972cf62c-016d-458c-ad59-663c1a881e81-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:23:59.463617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.463573    5073 generic.go:356] "Generic (PLEG): container finished" podID="972cf62c-016d-458c-ad59-663c1a881e81" containerID="9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96" exitCode=0
Oct 30 07:23:59.464122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.464080    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6" event={"ID":"972cf62c-016d-458c-ad59-663c1a881e81","Type":"ContainerDied","Data":"9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96"}
Oct 30 07:23:59.464365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.464322    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6" event={"ID":"972cf62c-016d-458c-ad59-663c1a881e81","Type":"ContainerDied","Data":"d70f92bb8540c7b2794c19c0eae38264a5816be6bd9ab6f91cceef5d67d6c0cc"}
Oct 30 07:23:59.464644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.464470    5073 scope.go:122] "RemoveContainer" containerID="9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96"
Oct 30 07:23:59.464838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.464807    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"
Oct 30 07:23:59.475916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.475897    5073 scope.go:122] "RemoveContainer" containerID="9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96"
Oct 30 07:23:59.476188 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:23:59.476169    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96\": container with ID starting with 9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96 not found: ID does not exist" containerID="9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96"
Oct 30 07:23:59.476251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.476199    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96"} err="failed to get container status \"9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96\": rpc error: code = NotFound desc = could not find container \"9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96\": container with ID starting with 9730e3c380abcf9bc6c79fe051b4d3707952b375a3a1964ca26f313535bcee96 not found: ID does not exist"
Oct 30 07:23:59.518790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.518721    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"]
Oct 30 07:23:59.521938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:23:59.521913    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-8d44bf-6bf489f6dd-w2cq6"]
Oct 30 07:24:01.422523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:01.422490    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="972cf62c-016d-458c-ad59-663c1a881e81" path="/var/lib/kubelet/pods/972cf62c-016d-458c-ad59-663c1a881e81/volumes"
Oct 30 07:24:07.548929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.548894    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"]
Oct 30 07:24:07.549699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549676    5073 cpu_manager.go:414] "containerMap: removing container" podUID="972cf62c-016d-458c-ad59-663c1a881e81" containerName="maas-api"
Oct 30 07:24:07.549699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549699    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="972cf62c-016d-458c-ad59-663c1a881e81" containerName="maas-api"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549713    5073 cpu_manager.go:414] "containerMap: removing container" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549718    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549753    5073 cpu_manager.go:414] "containerMap: removing container" podUID="4bcf9265-2ef3-46db-a90c-a656fb09a138" containerName="maas-api"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549759    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bcf9265-2ef3-46db-a90c-a656fb09a138" containerName="maas-api"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549810    5073 cpu_manager.go:414] "containerMap: removing container" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549816    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549825    5073 cpu_manager.go:414] "containerMap: removing container" podUID="8448edb3-57f8-45a4-a2bd-c35580797999" containerName="maas-api"
Oct 30 07:24:07.549847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549829    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8448edb3-57f8-45a4-a2bd-c35580797999" containerName="maas-api"
Oct 30 07:24:07.550239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549942    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bcf9265-2ef3-46db-a90c-a656fb09a138" containerName="maas-api"
Oct 30 07:24:07.550239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549960    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="63cb7d10-6130-42c2-b848-69f5b77e8fd9" containerName="istio-proxy"
Oct 30 07:24:07.550239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549968    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="8448edb3-57f8-45a4-a2bd-c35580797999" containerName="maas-api"
Oct 30 07:24:07.550239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549974    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="972cf62c-016d-458c-ad59-663c1a881e81" containerName="maas-api"
Oct 30 07:24:07.550239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.549980    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b96d4f3-05e6-4b83-b1fc-5cdec9c5d8db" containerName="istio-proxy"
Oct 30 07:24:07.553921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.553893    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.587671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.587641    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.587968 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.587942    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588070    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588100    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588189    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588228    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588268    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588294    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588363    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26t9\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.588826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.588564    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"]
Oct 30 07:24:07.689032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689000    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689043    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689068    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689085    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689120    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d26t9\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689174    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689201    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689306    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689328    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689570    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689616    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689721    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689725    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.689913 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.689889    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.691567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.691545    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.691808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.691790    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.713938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.713908    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.714080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.714062    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26t9\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:07.872050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:07.871686    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:08.218715 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.218681    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"]
Oct 30 07:24:08.225720 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:24:08.225688    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fb31f7_eabc_4b7c_9361_91708b6ff638.slice/crio-375087944e8aa1498d06361aad5144daa67b86f0458a03bc5869d592eb9a28da WatchSource:0}: Error finding container 375087944e8aa1498d06361aad5144daa67b86f0458a03bc5869d592eb9a28da: Status 404 returned error can't find the container with id 375087944e8aa1498d06361aad5144daa67b86f0458a03bc5869d592eb9a28da
Oct 30 07:24:08.228631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.228597    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:08.228719 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.228662    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:08.228719 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.228699    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:08.526003 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.525903    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" event={"ID":"16fb31f7-eabc-4b7c-9361-91708b6ff638","Type":"ContainerStarted","Data":"3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034"}
Oct 30 07:24:08.526178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.526007    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" event={"ID":"16fb31f7-eabc-4b7c-9361-91708b6ff638","Type":"ContainerStarted","Data":"375087944e8aa1498d06361aad5144daa67b86f0458a03bc5869d592eb9a28da"}
Oct 30 07:24:08.571222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.571167    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podStartSLOduration=1.571155477 podStartE2EDuration="1.571155477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:24:08.57044147 +0000 UTC m=+1651.278321639" watchObservedRunningTime="2026-10-30 07:24:08.571155477 +0000 UTC m=+1651.279035645"
Oct 30 07:24:08.876930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:08.874943    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:09.547558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:09.547526    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"]
Oct 30 07:24:09.547744 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:09.547710    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk" podUID="5c23f3da-ec66-4db3-9a64-a22832245aa4" containerName="maas-api" containerID="cri-o://371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5" gracePeriod=30
Oct 30 07:24:09.915360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:09.915009    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 07:24:09.915360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:09.915079    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 07:24:10.128347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.128042    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:24:10.258996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.258917    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49\" (UniqueName: \"kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49\") pod \"5c23f3da-ec66-4db3-9a64-a22832245aa4\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") "
Oct 30 07:24:10.259158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.259046    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls\") pod \"5c23f3da-ec66-4db3-9a64-a22832245aa4\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") "
Oct 30 07:24:10.259158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.259129    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs\") pod \"5c23f3da-ec66-4db3-9a64-a22832245aa4\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") "
Oct 30 07:24:10.259284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.259259    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca\") pod \"5c23f3da-ec66-4db3-9a64-a22832245aa4\" (UID: \"5c23f3da-ec66-4db3-9a64-a22832245aa4\") "
Oct 30 07:24:10.259617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.259587    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca" pod "5c23f3da-ec66-4db3-9a64-a22832245aa4" (UID: "5c23f3da-ec66-4db3-9a64-a22832245aa4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:24:10.260014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.259989    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c23f3da-ec66-4db3-9a64-a22832245aa4-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:10.261163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.261136    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs" pod "5c23f3da-ec66-4db3-9a64-a22832245aa4" (UID: "5c23f3da-ec66-4db3-9a64-a22832245aa4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:24:10.261267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.261170    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49" pod "5c23f3da-ec66-4db3-9a64-a22832245aa4" (UID: "5c23f3da-ec66-4db3-9a64-a22832245aa4"). InnerVolumeSpecName "kube-api-access-gfc49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:24:10.261267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.261206    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls" pod "5c23f3da-ec66-4db3-9a64-a22832245aa4" (UID: "5c23f3da-ec66-4db3-9a64-a22832245aa4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:24:10.361466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.361426    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:10.361466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.361456    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c23f3da-ec66-4db3-9a64-a22832245aa4-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:10.361685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.361466    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfc49\" (UniqueName: \"kubernetes.io/projected/5c23f3da-ec66-4db3-9a64-a22832245aa4-kube-api-access-gfc49\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:10.541332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.541243    5073 generic.go:356] "Generic (PLEG): container finished" podID="5c23f3da-ec66-4db3-9a64-a22832245aa4" containerID="371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5" exitCode=0
Oct 30 07:24:10.541332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.541290    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"
Oct 30 07:24:10.541332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.541325    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk" event={"ID":"5c23f3da-ec66-4db3-9a64-a22832245aa4","Type":"ContainerDied","Data":"371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5"}
Oct 30 07:24:10.541605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.541379    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk" event={"ID":"5c23f3da-ec66-4db3-9a64-a22832245aa4","Type":"ContainerDied","Data":"40a538da43323bd6cdc773db12773e6e7e484176e02e20f09774c76927e9df27"}
Oct 30 07:24:10.541605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.541409    5073 scope.go:122] "RemoveContainer" containerID="371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5"
Oct 30 07:24:10.552124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.551958    5073 scope.go:122] "RemoveContainer" containerID="371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5"
Oct 30 07:24:10.552283 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:24:10.552260    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5\": container with ID starting with 371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5 not found: ID does not exist" containerID="371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5"
Oct 30 07:24:10.552327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.552292    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5"} err="failed to get container status \"371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5\": rpc error: code = NotFound desc = could not find container \"371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5\": container with ID starting with 371fdf6bc149dacc47e2414594b13f42cdf7f345d31f2fe625d167333e401eb5 not found: ID does not exist"
Oct 30 07:24:10.612905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.612326    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"]
Oct 30 07:24:10.618758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.618729    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2340b1-74d789bfc5-6pstk"]
Oct 30 07:24:10.875935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.875184    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 07:24:10.875935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:10.875242    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 07:24:11.430983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:11.430945    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c23f3da-ec66-4db3-9a64-a22832245aa4" path="/var/lib/kubelet/pods/5c23f3da-ec66-4db3-9a64-a22832245aa4/volumes"
Oct 30 07:24:11.892685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:11.892228    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 07:24:11.892685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:11.892297    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 07:24:12.875213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:12.875175    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 07:24:12.875826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:12.875792    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 07:24:13.881294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:13.881256    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 07:24:13.881889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:13.881833    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 07:24:13.934956 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:24:13.934917    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:24:14.872661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:14.872629    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 07:24:14.872847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:14.872681    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 07:24:15.878732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:15.878700    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:15.879222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:15.879196    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:15.879974 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:15.879951    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:24:25.843103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:25.843064    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"]
Oct 30 07:24:25.843638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:25.843326    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4" podUID="813aaad7-d666-4304-99d2-08cda6ed447c" containerName="maas-api" containerID="cri-o://74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24" gracePeriod=30
Oct 30 07:24:26.168892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.168847    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:24:26.262977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.262937    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9\" (UniqueName: \"kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9\") pod \"813aaad7-d666-4304-99d2-08cda6ed447c\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") "
Oct 30 07:24:26.263185 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.263108    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs\") pod \"813aaad7-d666-4304-99d2-08cda6ed447c\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") "
Oct 30 07:24:26.263185 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.263146    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca\") pod \"813aaad7-d666-4304-99d2-08cda6ed447c\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") "
Oct 30 07:24:26.263321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.263186    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls\") pod \"813aaad7-d666-4304-99d2-08cda6ed447c\" (UID: \"813aaad7-d666-4304-99d2-08cda6ed447c\") "
Oct 30 07:24:26.264128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.263761    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca" pod "813aaad7-d666-4304-99d2-08cda6ed447c" (UID: "813aaad7-d666-4304-99d2-08cda6ed447c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:24:26.265786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.265756    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9" pod "813aaad7-d666-4304-99d2-08cda6ed447c" (UID: "813aaad7-d666-4304-99d2-08cda6ed447c"). InnerVolumeSpecName "kube-api-access-pbls9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:24:26.266257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.266230    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls" pod "813aaad7-d666-4304-99d2-08cda6ed447c" (UID: "813aaad7-d666-4304-99d2-08cda6ed447c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:24:26.267183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.267156    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs" pod "813aaad7-d666-4304-99d2-08cda6ed447c" (UID: "813aaad7-d666-4304-99d2-08cda6ed447c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:24:26.386927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.373051    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbls9\" (UniqueName: \"kubernetes.io/projected/813aaad7-d666-4304-99d2-08cda6ed447c-kube-api-access-pbls9\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:26.386927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.373096    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:26.386927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.373112    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/813aaad7-d666-4304-99d2-08cda6ed447c-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:26.386927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.373128    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/813aaad7-d666-4304-99d2-08cda6ed447c-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:26.823204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.820992    5073 generic.go:356] "Generic (PLEG): container finished" podID="813aaad7-d666-4304-99d2-08cda6ed447c" containerID="74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24" exitCode=0
Oct 30 07:24:26.823204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.821058    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"
Oct 30 07:24:26.823204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.821057    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4" event={"ID":"813aaad7-d666-4304-99d2-08cda6ed447c","Type":"ContainerDied","Data":"74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24"}
Oct 30 07:24:26.823204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.821163    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4" event={"ID":"813aaad7-d666-4304-99d2-08cda6ed447c","Type":"ContainerDied","Data":"6fc875abceb793ede14ac0e002ce45735b6a108658b809aaef8ee0c2dd09d32e"}
Oct 30 07:24:26.823204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.821214    5073 scope.go:122] "RemoveContainer" containerID="74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24"
Oct 30 07:24:26.839032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.837368    5073 scope.go:122] "RemoveContainer" containerID="74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24"
Oct 30 07:24:26.839032 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:24:26.837886    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24\": container with ID starting with 74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24 not found: ID does not exist" containerID="74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24"
Oct 30 07:24:26.839032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.837920    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24"} err="failed to get container status \"74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24\": rpc error: code = NotFound desc = could not find container \"74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24\": container with ID starting with 74055fb5154f13ece540696e7f829d08a038360dd190bfee86dac2b17384da24 not found: ID does not exist"
Oct 30 07:24:26.873936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.873901    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"]
Oct 30 07:24:26.884774 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:26.884747    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-89664e-55746fd95f-flmv4"]
Oct 30 07:24:27.422176 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:27.422133    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="813aaad7-d666-4304-99d2-08cda6ed447c" path="/var/lib/kubelet/pods/813aaad7-d666-4304-99d2-08cda6ed447c/volumes"
Oct 30 07:24:30.697723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.697682    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"]
Oct 30 07:24:30.698330 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.698314    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5c23f3da-ec66-4db3-9a64-a22832245aa4" containerName="maas-api"
Oct 30 07:24:30.698384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.698332    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c23f3da-ec66-4db3-9a64-a22832245aa4" containerName="maas-api"
Oct 30 07:24:30.698384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.698366    5073 cpu_manager.go:414] "containerMap: removing container" podUID="813aaad7-d666-4304-99d2-08cda6ed447c" containerName="maas-api"
Oct 30 07:24:30.698384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.698371    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="813aaad7-d666-4304-99d2-08cda6ed447c" containerName="maas-api"
Oct 30 07:24:30.698482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.698452    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c23f3da-ec66-4db3-9a64-a22832245aa4" containerName="maas-api"
Oct 30 07:24:30.698482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.698465    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="813aaad7-d666-4304-99d2-08cda6ed447c" containerName="maas-api"
Oct 30 07:24:30.702194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.702167    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.717705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.717681    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-2eda2c-openshift-default-dockercfg-bdk2w\""
Oct 30 07:24:30.734497 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.734474    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"]
Oct 30 07:24:30.834653 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.834604    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.834807 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.834775    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd7c9\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.834911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.834825    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.834954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.834916    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.835002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.834969    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.835144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.835125    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.835191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.835172    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.835247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.835225    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.835310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.835296    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.936731 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.936685    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.936952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.936790    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd7c9\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.936952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.936824    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.936952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.936845    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.936952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.936911    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937019    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937062    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937091    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937125    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937494    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937589    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937634    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937661    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.937940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.937920    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.940316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.940291    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.941320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.941300    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.959663 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.959603    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:30.959745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:30.959688    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd7c9\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:31.036182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.036137    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:31.359617 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:24:31.359585    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25318518_e554_4f0e_89e2_3ce2eb1d8db4.slice/crio-f7f2c9b655e4697fecf10e5bed83616f3d3a74062fbe28c20de0108d562e6bd8 WatchSource:0}: Error finding container f7f2c9b655e4697fecf10e5bed83616f3d3a74062fbe28c20de0108d562e6bd8: Status 404 returned error can't find the container with id f7f2c9b655e4697fecf10e5bed83616f3d3a74062fbe28c20de0108d562e6bd8
Oct 30 07:24:31.361309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.361286    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"]
Oct 30 07:24:31.362078 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.362039    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:31.362144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.362125    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:31.362181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.362166    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:31.855251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.855215    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" event={"ID":"25318518-e554-4f0e-89e2-3ce2eb1d8db4","Type":"ContainerStarted","Data":"e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde"}
Oct 30 07:24:31.855692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.855264    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" event={"ID":"25318518-e554-4f0e-89e2-3ce2eb1d8db4","Type":"ContainerStarted","Data":"f7f2c9b655e4697fecf10e5bed83616f3d3a74062fbe28c20de0108d562e6bd8"}
Oct 30 07:24:31.899652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:31.899594    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podStartSLOduration=1.899576757 podStartE2EDuration="1.899576757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:24:31.897772659 +0000 UTC m=+1674.605652829" watchObservedRunningTime="2026-10-30 07:24:31.899576757 +0000 UTC m=+1674.607456926"
Oct 30 07:24:32.036916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:32.036877    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:32.038833 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:32.038805    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:32.038966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:32.038867    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:33.037673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:33.037638    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:33.038142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:33.037690    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:34.036828 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:34.036795    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:34.037009 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:34.036844    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:35.036893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:35.036833    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:35.037301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:35.036922    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:36.037073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:36.037029    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:36.037591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:36.037108    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:37.037873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:37.037349    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:37.037873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:37.037409    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:38.042344 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:38.042312    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 07:24:38.042821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:38.042789    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 07:24:39.512422 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:39.510923    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:39.513542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:39.513512    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:39.513688 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:39.513598    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:24:40.537784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:40.537746    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"]
Oct 30 07:24:40.538265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:40.537988    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy" containerID="cri-o://969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee" gracePeriod=30
Oct 30 07:24:43.925150 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:24:43.925099    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:24:45.818720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.818661    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:24:45.865059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865028    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865078    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865163    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865196    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865244    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865289    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865349    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:24:45.865548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865419    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865566    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.865659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865631    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2\") pod \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\" (UID: \"61798c7b-2ae7-4d0c-affe-2095cf6b165b\") "
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865541    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865567    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865573    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.865932    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.866258    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.866278    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.866292    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.866327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.866305    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.870660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.870631    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:24:45.878752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.878726    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "kube-api-access-t92l2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:24:45.878934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.878765    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:24:45.880020 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.879998    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy" pod "61798c7b-2ae7-4d0c-affe-2095cf6b165b" (UID: "61798c7b-2ae7-4d0c-affe-2095cf6b165b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:24:45.968122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.968090    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t92l2\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-kube-api-access-t92l2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.968122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.968124    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.968394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.968138    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.968394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.968151    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:45.968394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:45.968164    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61798c7b-2ae7-4d0c-affe-2095cf6b165b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:24:46.011689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.011655    5073 generic.go:356] "Generic (PLEG): container finished" podID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerID="969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee" exitCode=0
Oct 30 07:24:46.011922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.011703    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"
Oct 30 07:24:46.011922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.011738    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" event={"ID":"61798c7b-2ae7-4d0c-affe-2095cf6b165b","Type":"ContainerDied","Data":"969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee"}
Oct 30 07:24:46.011922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.011806    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2" event={"ID":"61798c7b-2ae7-4d0c-affe-2095cf6b165b","Type":"ContainerDied","Data":"0551dbbef90a16fa547e404451392d0aa26f56c17a266e3eb3cedeaa15f4116a"}
Oct 30 07:24:46.011922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.011837    5073 scope.go:122] "RemoveContainer" containerID="969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee"
Oct 30 07:24:46.022713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.022697    5073 scope.go:122] "RemoveContainer" containerID="969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee"
Oct 30 07:24:46.023008 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:24:46.022989    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee\": container with ID starting with 969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee not found: ID does not exist" containerID="969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee"
Oct 30 07:24:46.023073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.023015    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee"} err="failed to get container status \"969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee\": rpc error: code = NotFound desc = could not find container \"969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee\": container with ID starting with 969e04b85f4737a9d44002b3c1186e44faf45a6faafea2e5b228307c6e3bdaee not found: ID does not exist"
Oct 30 07:24:46.070024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.069966    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"]
Oct 30 07:24:46.075993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:46.075972    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-kt2r2"]
Oct 30 07:24:47.428519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:47.428475    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" path="/var/lib/kubelet/pods/61798c7b-2ae7-4d0c-affe-2095cf6b165b/volumes"
Oct 30 07:24:52.449487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.449451    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"]
Oct 30 07:24:52.450521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.450491    5073 cpu_manager.go:414] "containerMap: removing container" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy"
Oct 30 07:24:52.450521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.450514    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy"
Oct 30 07:24:52.450695 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.450626    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="61798c7b-2ae7-4d0c-affe-2095cf6b165b" containerName="istio-proxy"
Oct 30 07:24:52.455617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.455597    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.492131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.492091    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"]
Oct 30 07:24:52.548996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.548962    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549080    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549109    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549206    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549224    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549253    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549362    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549421 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549406    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.549455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.549428    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnt7d\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.650820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.650778    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.650826    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.650886    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnt7d\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.650969    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651093    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651138    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651241    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651258    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651270    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651318    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651337    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651504    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651551    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.651677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.651599    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.653436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.653417    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.653646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.653627    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.673448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.673425    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.673734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.673709    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnt7d\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d\") pod \"e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") " pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:52.773270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:52.773187    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:53.093167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:53.093133    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"]
Oct 30 07:24:53.093619 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:24:53.093593    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fa46b7_c2a7_40e8_bdc3_306128f00246.slice/crio-9ab1e5078e6bc9f5012e6304665b2c3de2ba52281c64441211e224d208cc6d3e WatchSource:0}: Error finding container 9ab1e5078e6bc9f5012e6304665b2c3de2ba52281c64441211e224d208cc6d3e: Status 404 returned error can't find the container with id 9ab1e5078e6bc9f5012e6304665b2c3de2ba52281c64441211e224d208cc6d3e
Oct 30 07:24:53.096148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:53.096110    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:53.096260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:53.096177    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:53.096260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:53.096206    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:24:54.067403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:54.067370    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" event={"ID":"79fa46b7-c2a7-40e8-bdc3-306128f00246","Type":"ContainerStarted","Data":"0c79f8e84d3cea5a1fa7b8ca8cd02e9cc818bbf5cb6b40c4fc8a1fdb0970e20d"}
Oct 30 07:24:54.067794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:54.067420    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" event={"ID":"79fa46b7-c2a7-40e8-bdc3-306128f00246","Type":"ContainerStarted","Data":"9ab1e5078e6bc9f5012e6304665b2c3de2ba52281c64441211e224d208cc6d3e"}
Oct 30 07:24:54.128874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:54.127977    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podStartSLOduration=2.127956372 podStartE2EDuration="2.127956372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:24:54.123173002 +0000 UTC m=+1696.831053186" watchObservedRunningTime="2026-10-30 07:24:54.127956372 +0000 UTC m=+1696.835836542"
Oct 30 07:24:54.784286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:54.783840    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:24:54.784286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:54.783988    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:24:54.784286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:54.784036    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:24:55.776325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:55.776285    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:24:55.776992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:55.776947    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:24:56.775121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:56.775081    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:24:56.775445 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:56.775416    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:24:57.362876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:57.362439    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:57.408576 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:57.408529    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:57.788325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:57.788287    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:24:57.788623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:57.788591    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:24:57.940878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:57.924999    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:57.942189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:57.942138    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:58.202876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.195363    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:58.410064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.410013    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:24:58.412339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.410642    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:24:58.412339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.411052    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:58.412339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.411511    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:24:58.953876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.803427    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:24:58.978886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:58.969003    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:24:59.025096 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.025050    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:24:59.050298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.050261    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:24:59.334925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.305559    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:24:59.334925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.331973    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:24:59.384780 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.367620    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:24:59.782621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.782588    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:24:59.783214 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:24:59.783181    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:25:00.778882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.775183    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:25:00.778882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.775241    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:25:00.810608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.810568    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"]
Oct 30 07:25:00.817557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.817533    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.830555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.830512    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"]
Oct 30 07:25:00.918721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.918680    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919060    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8n7r\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919251    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919405    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919552    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919702 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919687    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919818 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919803    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.919967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.919951    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:00.920105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:00.920091    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021222    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021382    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8n7r\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021431    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021470    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021498    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021538    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021571    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021597    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021646    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.021988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.021687    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.022052 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.022038    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.022229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.022207    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.022299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.022243    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.022459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.022433    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.023994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.023970    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.024235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.024217    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.048335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.048265    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8n7r\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.049614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.049582    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.137811 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.137771    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:01.537197 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:01.537161    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03903cb4_dd8c_439d_b855_68127f4b7ad1.slice/crio-3f4d339ac0fc78422918aa05bf6ff6e411ebefa3027c362c7f25313d142be55e WatchSource:0}: Error finding container 3f4d339ac0fc78422918aa05bf6ff6e411ebefa3027c362c7f25313d142be55e: Status 404 returned error can't find the container with id 3f4d339ac0fc78422918aa05bf6ff6e411ebefa3027c362c7f25313d142be55e
Oct 30 07:25:01.537324 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.537264    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"]
Oct 30 07:25:01.539880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.539820    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:01.539970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.539902    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:01.539970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.539935    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:01.774406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.774366    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused" start-of-body=
Oct 30 07:25:01.774601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:01.774434    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": dial tcp 10.132.0.129:15021: connect: connection refused"
Oct 30 07:25:02.344235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:02.344187    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" event={"ID":"03903cb4-dd8c-439d-b855-68127f4b7ad1","Type":"ContainerStarted","Data":"5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf"}
Oct 30 07:25:02.344683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:02.344254    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" event={"ID":"03903cb4-dd8c-439d-b855-68127f4b7ad1","Type":"ContainerStarted","Data":"3f4d339ac0fc78422918aa05bf6ff6e411ebefa3027c362c7f25313d142be55e"}
Oct 30 07:25:02.408875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:02.408576    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podStartSLOduration=2.408555899 podStartE2EDuration="2.408555899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:02.407810415 +0000 UTC m=+1705.115690597" watchObservedRunningTime="2026-10-30 07:25:02.408555899 +0000 UTC m=+1705.116436069"
Oct 30 07:25:03.138063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.138007    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:03.140157 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.140121    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 07:25:03.140309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.140197    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 07:25:03.824091 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.824043    5073 patch_prober.go:29] interesting pod/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.129:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:25:03.824552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.824122    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.129:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:03.851879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.851835    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:25:03.852494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.852470    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:25:03.853778 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:03.853700    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:25:04.138232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:04.138191    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 07:25:04.138446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:04.138254    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 07:25:05.138870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:05.138812    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 07:25:05.139256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:05.138917    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 07:25:06.138626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:06.138586    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 07:25:06.138805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:06.138647    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 07:25:07.156876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:07.148542    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 07:25:07.156876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:07.148601    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 07:25:08.138423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:08.138376    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 30 07:25:08.138608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:08.138453    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 30 07:25:09.348376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:09.348337    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:09.348838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:09.348785    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:09.349913 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:09.349888    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:25:12.068338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.068292    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"]
Oct 30 07:25:12.087515 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.087481    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.136196 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.136154    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"]
Oct 30 07:25:12.168366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168325    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168443    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168495    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168535    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168602    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8g2\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168624    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168653    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168700    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.168785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.168751    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.269468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269428    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.269649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269602    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.269711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269658    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.269767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269709    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.269767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269745    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8g2\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269775    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269832    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269947    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.269956    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.270071    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.270082    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.270164    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.270330    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.270546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.270523    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.272132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.272103    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.272607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.272581    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.292676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.292648    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.292946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.292923    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8g2\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.430430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.430391    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:12.749515 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.749485    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"]
Oct 30 07:25:12.749623 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:12.749523    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6662718_864f_44d1_adec_9fcca8d93b24.slice/crio-199b3e665d42b592ecf5f0e2e67e5f3855a227d5e7aed2955cbe1b2d1d83cf6e WatchSource:0}: Error finding container 199b3e665d42b592ecf5f0e2e67e5f3855a227d5e7aed2955cbe1b2d1d83cf6e: Status 404 returned error can't find the container with id 199b3e665d42b592ecf5f0e2e67e5f3855a227d5e7aed2955cbe1b2d1d83cf6e
Oct 30 07:25:12.752182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.752151    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:12.752268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.752211    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:12.752268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:12.752239    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:13.523573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:13.522424    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" event={"ID":"a6662718-864f-44d1-adec-9fcca8d93b24","Type":"ContainerStarted","Data":"01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e"}
Oct 30 07:25:13.523573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:13.522500    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" event={"ID":"a6662718-864f-44d1-adec-9fcca8d93b24","Type":"ContainerStarted","Data":"199b3e665d42b592ecf5f0e2e67e5f3855a227d5e7aed2955cbe1b2d1d83cf6e"}
Oct 30 07:25:13.569697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:13.569639    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podStartSLOduration=1.569625601 podStartE2EDuration="1.569625601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:13.567261818 +0000 UTC m=+1716.275141979" watchObservedRunningTime="2026-10-30 07:25:13.569625601 +0000 UTC m=+1716.277505829"
Oct 30 07:25:13.938372 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:25:13.938339    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:25:14.431089 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:14.431050    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:14.432588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:14.432561    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:14.432723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:14.432619    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:15.430737 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:15.430704    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:15.431172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:15.430755    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:16.435339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:16.435296    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:16.436042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:16.436005    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:17.431609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:17.431563    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:17.431814 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:17.431644    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:18.431202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:18.431161    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:18.431712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:18.431231    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:19.432017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:19.431979    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:19.432659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:19.432620    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:20.514881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:20.495459    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused" start-of-body=
Oct 30 07:25:20.538021 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:20.537974    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": dial tcp 10.132.0.131:15021: connect: connection refused"
Oct 30 07:25:21.311008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.310947    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:21.340007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.339946    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:21.400882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.400816    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:21.828884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.803729    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"]
Oct 30 07:25:21.929876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.928432    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:21.930069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.929936    5073 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:21.973876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:21.956963    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"]
Oct 30 07:25:22.141619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.043720    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-04aede-openshift-default-dockercfg-qhx9g\""
Oct 30 07:25:22.141919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.121923    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:25:22.143216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.122703    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.144972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.144949    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.145264 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.145221    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.145610 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.145588    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.145824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.145802    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.146074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.146053    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.146319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.146298    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.146617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.146596    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.146830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.146800    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dp8p\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.332875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.331927    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.337900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.332122    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.342346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.342297    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:25:22.358013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.357976    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:25:22.372587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.372540    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:22.373267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.373242    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.384665    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.384745    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.384790    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.384821    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.385039    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.385108    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dp8p\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.385226    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.390125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.389318    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.415150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.415075    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.432952 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.417064    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.433187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.417622    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.433290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.417916    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.437441 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.437403    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.496537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.487734    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:22.496537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.488603    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.530400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.529910    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.131:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:25:22.530400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.529971    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.131:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:25:22.537565 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.537529    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 07:25:22.547897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.546551    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dp8p\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.547897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.547039    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 07:25:22.567022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.566981    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy\") pod \"e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") " pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.776667 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.776568    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:22.779692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.778920    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:22.781766 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.781713    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:22.784284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:22.784264    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:25:23.143579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:23.143542    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"]
Oct 30 07:25:23.152177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:23.150392    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:23.152177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:23.150461    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:23.152177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:23.150493    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:24.179188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:24.179151    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" event={"ID":"b6b27249-97a4-4973-9dc6-5ccb7696e7b0","Type":"ContainerStarted","Data":"4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"}
Oct 30 07:25:24.179840 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:24.179802    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" event={"ID":"b6b27249-97a4-4973-9dc6-5ccb7696e7b0","Type":"ContainerStarted","Data":"b66a0317f502bc851cafb6bfba6ffa8f6bf992609e9029081a5093d20903d510"}
Oct 30 07:25:24.237974 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:24.237908    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podStartSLOduration=3.237886646 podStartE2EDuration="3.237886646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:24.235469914 +0000 UTC m=+1726.943350083" watchObservedRunningTime="2026-10-30 07:25:24.237886646 +0000 UTC m=+1726.945766817"
Oct 30 07:25:24.777033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:24.776991    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:24.783147 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:24.783114    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:25.183207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:25.183172    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:25.184294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:25.184273    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:25:30.495600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.495568    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"]
Oct 30 07:25:30.500578 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.500553    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.526319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.526287    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-14271d-serving-cert\""
Oct 30 07:25:30.529839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.529812    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"]
Oct 30 07:25:30.617225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.617186    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94kn6\" (UniqueName: \"kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.617448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.617249    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.617448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.617329    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.617543 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.617479    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.718713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.718660    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.718713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.718718    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.719036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.718822    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.719036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.718992    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94kn6\" (UniqueName: \"kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.719527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.719499    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.721454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.721435    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.721579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.721557    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.745447 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.745419    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94kn6\" (UniqueName: \"kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6\") pod \"maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:30.815908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:30.815812    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:31.197564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.195310    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"]
Oct 30 07:25:31.197775 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:31.197700    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7644ada_8fa5_472e_805b_f9aac69a2709.slice/crio-34e982cbbde712ece560ef5cad5dcbb2d886fae60d13868030fde3ba60099fdd WatchSource:0}: Error finding container 34e982cbbde712ece560ef5cad5dcbb2d886fae60d13868030fde3ba60099fdd: Status 404 returned error can't find the container with id 34e982cbbde712ece560ef5cad5dcbb2d886fae60d13868030fde3ba60099fdd
Oct 30 07:25:31.198932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.198907    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:25:31.229068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.229032    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk" event={"ID":"b7644ada-8fa5-472e-805b-f9aac69a2709","Type":"ContainerStarted","Data":"34e982cbbde712ece560ef5cad5dcbb2d886fae60d13868030fde3ba60099fdd"}
Oct 30 07:25:31.497103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.497026    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"]
Oct 30 07:25:31.503273 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.503247    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.536921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.536788    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"]
Oct 30 07:25:31.632269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632232    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632403    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632458    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632616 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632592    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632670 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632634    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfdbj\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632709    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632794    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632871    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.632959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.632916    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734126    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734168    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfdbj\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734192    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734255    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734281    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734309    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734388    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734480    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734527    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.734896 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734871    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.735026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734892    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.735026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.734927    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.735151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.735034    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.735223 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.735203    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.736747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.736727    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.737671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.737644    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.757550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.757494    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.757736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.757714    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfdbj\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj\") pod \"e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") " pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:31.824688 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:31.824298    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:32.191093 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:32.191054    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6414a4_9682_4d4f_b315_839634fc241b.slice/crio-c3c75b256d328900c9f1374b142f2092c64a66d256b45b1e1cbb88a8817b3785 WatchSource:0}: Error finding container c3c75b256d328900c9f1374b142f2092c64a66d256b45b1e1cbb88a8817b3785: Status 404 returned error can't find the container with id c3c75b256d328900c9f1374b142f2092c64a66d256b45b1e1cbb88a8817b3785
Oct 30 07:25:32.192659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.192626    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"]
Oct 30 07:25:32.193887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.193837    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:32.193972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.193955    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:32.194041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.194002    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:32.238920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.238883    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk" event={"ID":"b7644ada-8fa5-472e-805b-f9aac69a2709","Type":"ContainerStarted","Data":"60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7"}
Oct 30 07:25:32.239057 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.238980    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:32.240656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.240635    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" event={"ID":"fd6414a4-9682-4d4f-b315-839634fc241b","Type":"ContainerStarted","Data":"c3c75b256d328900c9f1374b142f2092c64a66d256b45b1e1cbb88a8817b3785"}
Oct 30 07:25:32.283429 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:32.283378    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk" podStartSLOduration=1.821584487 podStartE2EDuration="2.283363448s" totalImagesPullingTime="461.778961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:32.278958926 +0000 UTC m=+1734.986839094" watchObservedRunningTime="2026-10-30 07:25:32.283363448 +0000 UTC m=+1734.991243670"
Oct 30 07:25:33.248797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:33.248760    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" event={"ID":"fd6414a4-9682-4d4f-b315-839634fc241b","Type":"ContainerStarted","Data":"61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe"}
Oct 30 07:25:33.825342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:33.825307    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:33.826980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:33.826943    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 07:25:33.827124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:33.826999    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 07:25:34.825623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:34.825585    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 07:25:34.826038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:34.825643    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 07:25:35.825866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:35.825827    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 07:25:35.826242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:35.825917    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 07:25:36.825025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:36.824980    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 07:25:36.825216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:36.825045    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 07:25:37.825499 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:37.825465    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 07:25:37.825934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:37.825518    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 07:25:38.254988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:38.254959    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 07:25:38.297034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:38.296980    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podStartSLOduration=7.296965517 podStartE2EDuration="7.296965517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:33.320308017 +0000 UTC m=+1736.028188186" watchObservedRunningTime="2026-10-30 07:25:38.296965517 +0000 UTC m=+1741.004845686"
Oct 30 07:25:38.825993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:38.825951    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 07:25:38.826386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:38.826023    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 07:25:39.829682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:39.829648    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:39.830138 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:39.830088    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:39.830929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:39.830909    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:25:41.892377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:41.892336    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"]
Oct 30 07:25:41.910378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:41.910350    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:41.936919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:41.929372    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-932c00-serving-cert\""
Oct 30 07:25:41.937700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:41.937640    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"]
Oct 30 07:25:42.157830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.157730    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.189132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.189092    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.189608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.189579    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnsp6\" (UniqueName: \"kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.189798 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.189782    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.293755    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.293928    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnsp6\" (UniqueName: \"kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.293977    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.294134    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.295072    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:25:42.295229    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-serving-cert: secret "maas-api-e2e-shared-a-w2-932c00-serving-cert" not found
Oct 30 07:25:42.299869 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:25:42.295307    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls podName:ad813659-e8b5-47f0-b5c7-4fbc76dc377e nodeName:}" failed. No retries permitted until 2026-10-30 07:25:42.795284379 +0000 UTC m=+1745.503164540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls") pod "maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" (UID: "ad813659-e8b5-47f0-b5c7-4fbc76dc377e") : secret "maas-api-e2e-shared-a-w2-932c00-serving-cert" not found
Oct 30 07:25:42.321820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.321782    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.356868 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.356824    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnsp6\" (UniqueName: \"kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.807544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.806952    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.839385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.839353    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:42.840196 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:42.840161    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:43.562446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:43.562416    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"]
Oct 30 07:25:43.562865 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:43.562786    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad813659_e8b5_47f0_b5c7_4fbc76dc377e.slice/crio-485435f76c1a2893648c4ca9db94dd3107d2f68095750e762fc6af79aa0c9a40 WatchSource:0}: Error finding container 485435f76c1a2893648c4ca9db94dd3107d2f68095750e762fc6af79aa0c9a40: Status 404 returned error can't find the container with id 485435f76c1a2893648c4ca9db94dd3107d2f68095750e762fc6af79aa0c9a40
Oct 30 07:25:43.927279 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:25:43.927238    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:25:44.377207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:44.377171    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" event={"ID":"ad813659-e8b5-47f0-b5c7-4fbc76dc377e","Type":"ContainerStarted","Data":"78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea"}
Oct 30 07:25:44.377405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:44.377226    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" event={"ID":"ad813659-e8b5-47f0-b5c7-4fbc76dc377e","Type":"ContainerStarted","Data":"485435f76c1a2893648c4ca9db94dd3107d2f68095750e762fc6af79aa0c9a40"}
Oct 30 07:25:44.377405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:44.377304    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:44.420897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:44.418945    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" podStartSLOduration=3.102227908 podStartE2EDuration="3.418928972s" totalImagesPullingTime="316.701064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:44.417441755 +0000 UTC m=+1747.125321924" watchObservedRunningTime="2026-10-30 07:25:44.418928972 +0000 UTC m=+1747.126809152"
Oct 30 07:25:45.834627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.834580    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"]
Oct 30 07:25:45.839172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.839152    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:45.852962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.852941    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-04aede-serving-cert\""
Oct 30 07:25:45.878400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.870048    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"]
Oct 30 07:25:45.931471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.931427    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"]
Oct 30 07:25:45.936915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.936877    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:45.944301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.944274    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxtk2\" (UniqueName: \"kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:45.944444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.944326    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:45.944444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.944373    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:45.944565 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.944541    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:45.963351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:45.963325    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"]
Oct 30 07:25:46.046005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.045971    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046014    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jktbr\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046128    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046171    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046198    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.046266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046215    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046380    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046455    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtk2\" (UniqueName: \"kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.046511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046490    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.046562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046521    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.046597 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046566    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046744    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.046903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.046809    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.047176 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.047155    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.049051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.049021    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.049051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.049031    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.068652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.068621    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtk2\" (UniqueName: \"kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2\") pod \"maas-api-e2e-autores-04aede-587d5567-vvmwk\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.148034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.147994    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148044    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jktbr\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148094    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148136    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148225 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148170    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148260    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148428    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148447    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148475    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148504    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148503    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148598    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.148834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.148715    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.149184 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.149162    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.151118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.151095    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.151270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.151176    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.153306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.153261    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:46.174458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.174364    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.176543 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.176489    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jktbr\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.253384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.253353    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:46.472868 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:46.472815    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964b8e3d_a7ca_4794_8ba3_fbf4d4d13eeb.slice/crio-fae00209ea9a23ae22f5bdda017cfc307f1ca81d899636a710a335e6d6c07393 WatchSource:0}: Error finding container fae00209ea9a23ae22f5bdda017cfc307f1ca81d899636a710a335e6d6c07393: Status 404 returned error can't find the container with id fae00209ea9a23ae22f5bdda017cfc307f1ca81d899636a710a335e6d6c07393
Oct 30 07:25:46.472989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.472864    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"]
Oct 30 07:25:46.585014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.581614    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"]
Oct 30 07:25:46.585958 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:46.585755    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed3b29a_52b7_49cb_bafb_aef1663e8cb7.slice/crio-24be4ba4a1da06af461c15e67e4c3ebb385834fba1b1f8d599401ff0995f2688 WatchSource:0}: Error finding container 24be4ba4a1da06af461c15e67e4c3ebb385834fba1b1f8d599401ff0995f2688: Status 404 returned error can't find the container with id 24be4ba4a1da06af461c15e67e4c3ebb385834fba1b1f8d599401ff0995f2688
Oct 30 07:25:46.588378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.588328    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:46.588479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.588424    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:46.588479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:46.588466    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:47.404563 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.404527    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" event={"ID":"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7","Type":"ContainerStarted","Data":"3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621"}
Oct 30 07:25:47.405114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.404597    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" event={"ID":"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7","Type":"ContainerStarted","Data":"24be4ba4a1da06af461c15e67e4c3ebb385834fba1b1f8d599401ff0995f2688"}
Oct 30 07:25:47.406924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.406896    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk" event={"ID":"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb","Type":"ContainerStarted","Data":"e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a"}
Oct 30 07:25:47.407074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.406937    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk" event={"ID":"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb","Type":"ContainerStarted","Data":"fae00209ea9a23ae22f5bdda017cfc307f1ca81d899636a710a335e6d6c07393"}
Oct 30 07:25:47.407074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.406976    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:47.451055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.451002    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podStartSLOduration=2.450988713 podStartE2EDuration="2.450988713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:47.448280469 +0000 UTC m=+1750.156160670" watchObservedRunningTime="2026-10-30 07:25:47.450988713 +0000 UTC m=+1750.158868881"
Oct 30 07:25:47.491942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:47.488550    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk" podStartSLOduration=2.004641426 podStartE2EDuration="2.488532214s" totalImagesPullingTime="483.890788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:47.487941699 +0000 UTC m=+1750.195821894" watchObservedRunningTime="2026-10-30 07:25:47.488532214 +0000 UTC m=+1750.196412384"
Oct 30 07:25:48.253687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:48.253649    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:48.255042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:48.255007    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Oct 30 07:25:48.255160 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:48.255057    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Oct 30 07:25:49.254353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:49.254317    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Oct 30 07:25:49.254729 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:49.254367    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Oct 30 07:25:50.254362 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:50.254325    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Oct 30 07:25:50.254937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:50.254391    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Oct 30 07:25:50.399450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:50.399414    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 07:25:51.253973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:51.253933    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Oct 30 07:25:51.254173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:51.253996    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Oct 30 07:25:52.254653 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:52.254614    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Oct 30 07:25:52.255211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:52.254679    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Oct 30 07:25:53.254215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:53.254183    5073 patch_prober.go:29] interesting pod/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused" start-of-body=
Oct 30 07:25:53.254383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:53.254236    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.137:15021/healthz/ready\": dial tcp 10.132.0.137:15021: connect: connection refused"
Oct 30 07:25:53.434123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:53.434093    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:25:54.309744 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.309705    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"]
Oct 30 07:25:54.315783 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.315754    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.329525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.329501    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-bd8589-serving-cert\""
Oct 30 07:25:54.348300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.348270    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"]
Oct 30 07:25:54.454112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.454072    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.454602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.454317    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.454602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.454377    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82256\" (UniqueName: \"kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.454602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.454543    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.547268    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.550142    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.556293    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.556499    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.556554    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82256\" (UniqueName: \"kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.556650    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.565071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.558307    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.594876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.582360    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.611872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.610263    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.614555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.614523    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82256\" (UniqueName: \"kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256\") pod \"maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:54.621603 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.621528    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:25:54.635464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:54.634025    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:55.005001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:55.004972    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"]
Oct 30 07:25:55.005154 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:55.004980    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef277a0_b7d4_4882_9adb_309a713ccb74.slice/crio-c1ff8050ce565213efa4664caebef86768cfecd53abc348d07279bba4ba6189e WatchSource:0}: Error finding container c1ff8050ce565213efa4664caebef86768cfecd53abc348d07279bba4ba6189e: Status 404 returned error can't find the container with id c1ff8050ce565213efa4664caebef86768cfecd53abc348d07279bba4ba6189e
Oct 30 07:25:55.480926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:55.480881    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp" event={"ID":"2ef277a0-b7d4-4882-9adb-309a713ccb74","Type":"ContainerStarted","Data":"c1ff8050ce565213efa4664caebef86768cfecd53abc348d07279bba4ba6189e"}
Oct 30 07:25:56.488995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:56.488959    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp" event={"ID":"2ef277a0-b7d4-4882-9adb-309a713ccb74","Type":"ContainerStarted","Data":"4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c"}
Oct 30 07:25:56.489456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:56.489222    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:25:56.529835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:56.529779    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp" podStartSLOduration=2.152236949 podStartE2EDuration="2.529765088s" totalImagesPullingTime="377.528139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:56.528542237 +0000 UTC m=+1759.236422427" watchObservedRunningTime="2026-10-30 07:25:56.529765088 +0000 UTC m=+1759.237645253"
Oct 30 07:25:57.183343 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.183306    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"]
Oct 30 07:25:57.188256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.188230    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.215815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.215776    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"]
Oct 30 07:25:57.317349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317289    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317411    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317483    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317505    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317539    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkhfx\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317560    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317729 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317699    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317778 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317761    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.317997 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.317979    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419021 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.418981    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419037    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419089    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkhfx\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419120    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419171    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419228    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419493 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419395    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419505    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419537    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419551    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419715 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419582    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.419978 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.419953    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.420465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.420439    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.420683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.420658    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.422527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.422499    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.422709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.422690    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.442012 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.441961    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkhfx\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.442012 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.441993    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token\") pod \"e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") " pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.520625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.520590    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:57.868739 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:25:57.868707    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43d1aea_dc5d_4356_8a07_00d4851d01f0.slice/crio-bb587fc0c03e91c775f670e8ec5cdc8085f764af472c7bd20a8d8215f1a7434d WatchSource:0}: Error finding container bb587fc0c03e91c775f670e8ec5cdc8085f764af472c7bd20a8d8215f1a7434d: Status 404 returned error can't find the container with id bb587fc0c03e91c775f670e8ec5cdc8085f764af472c7bd20a8d8215f1a7434d
Oct 30 07:25:57.869089 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.869064    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"]
Oct 30 07:25:57.871482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.871447    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:57.871562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.871528    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:57.871613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:57.871568    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:25:58.503697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:58.503660    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" event={"ID":"a43d1aea-dc5d-4356-8a07-00d4851d01f0","Type":"ContainerStarted","Data":"6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4"}
Oct 30 07:25:58.503911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:58.503724    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" event={"ID":"a43d1aea-dc5d-4356-8a07-00d4851d01f0","Type":"ContainerStarted","Data":"bb587fc0c03e91c775f670e8ec5cdc8085f764af472c7bd20a8d8215f1a7434d"}
Oct 30 07:25:58.521711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:58.521674    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:25:58.523717 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:58.523688    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:25:58.523906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:58.523745    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:25:58.555183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:58.555122    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podStartSLOduration=1.555105511 podStartE2EDuration="1.555105511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:25:58.546400534 +0000 UTC m=+1761.254280704" watchObservedRunningTime="2026-10-30 07:25:58.555105511 +0000 UTC m=+1761.262985681"
Oct 30 07:25:59.521007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:59.520975    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:25:59.521327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:25:59.521024    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:00.521073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:00.521039    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:26:00.521462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:00.521101    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:01.522037 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:01.521990    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:26:01.522556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:01.522093    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:01.859720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:01.859635    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"]
Oct 30 07:26:01.865641 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:01.865615    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:01.940111 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:01.940068    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"]
Oct 30 07:26:02.039366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039320    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039428    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039474    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gcfs\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039501    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039551    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039737    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039803    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.039970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.039946    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.040079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.040064    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.144865 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.144800    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.145684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.145661    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.145869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.145837    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gcfs\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.146005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.145988    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.146107 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.146093    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.146533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.146513    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.146725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.146709    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.146830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.146817    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.147022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.147008    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.152216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.145579    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.152692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.152670    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.156908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.153300    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.176873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.157762    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.177187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.163603    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.200985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.193788    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gcfs\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.201673 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.201551    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.202184 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.202157    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.203369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.203322    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token\") pod \"e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") " pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.245686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.245578    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:02.516103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.516016    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 07:26:02.521036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.520994    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:26:02.521205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.521054    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:02.624181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.620590    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"]
Oct 30 07:26:02.624181 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:26:02.623746    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9a37f1_ca34_4fbf_9c6d_33ff4a09a97c.slice/crio-650feebb005d8479c9d6cf05f95e4cc3cc9033587aaa48fc387f2e8da2c04b45 WatchSource:0}: Error finding container 650feebb005d8479c9d6cf05f95e4cc3cc9033587aaa48fc387f2e8da2c04b45: Status 404 returned error can't find the container with id 650feebb005d8479c9d6cf05f95e4cc3cc9033587aaa48fc387f2e8da2c04b45
Oct 30 07:26:02.627790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.627058    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:02.627790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.627144    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:02.627790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:02.627190    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:03.522052 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:03.522008    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:26:03.522243 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:03.522080    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:03.567979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:03.566347    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" event={"ID":"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c","Type":"ContainerStarted","Data":"a0312ba1a79e812a4071113ce130baa4bf8cb964d45eab9e2ad0c8939905737d"}
Oct 30 07:26:03.567979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:03.566424    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" event={"ID":"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c","Type":"ContainerStarted","Data":"650feebb005d8479c9d6cf05f95e4cc3cc9033587aaa48fc387f2e8da2c04b45"}
Oct 30 07:26:03.653247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:03.653179    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podStartSLOduration=2.653163246 podStartE2EDuration="2.653163246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:03.637334324 +0000 UTC m=+1766.345214522" watchObservedRunningTime="2026-10-30 07:26:03.653163246 +0000 UTC m=+1766.361043513"
Oct 30 07:26:04.262875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:04.262453    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:04.284023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:04.275231    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:04.284023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:04.275288    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:04.521034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:04.520942    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:26:04.521034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:04.520998    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:05.155317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.126633    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"]
Oct 30 07:26:05.166330 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.166303    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"]
Oct 30 07:26:05.166590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.166575    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.194883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.188275    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-06e19a-openshift-default-dockercfg-7ptkv\""
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.318011    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.318113    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321381    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321429    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321533    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321558    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321607    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ktd6\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321715    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321739    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321779    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.347776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.321802    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.479958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.479864    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.480209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.480187    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.480374 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.480345    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ktd6\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.480636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.480592    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.480769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.480753    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.480918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.480902    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.481032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.481017    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.481245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.481229    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.481365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.481352    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.482066 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.482043    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.483539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.483193    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.490697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.490664    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.491758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.491727    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.492186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.492164    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.521728 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.521666    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.521936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.521907    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 07:26:05.522030 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.521983    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 07:26:05.559877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.550534    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ktd6\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.563139 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.563078    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.563767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.563721    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token\") pod \"e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") " pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:05.803363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:05.802980    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:06.230492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.230451    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"]
Oct 30 07:26:06.235028 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:26:06.234371    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8f8ad1_7d95_48e4_95f0_cd2b71078e23.slice/crio-2729c06912bcaadbfcfc9d50c7e478a6d5e31e7b12282ce075cca6a0660ffedb WatchSource:0}: Error finding container 2729c06912bcaadbfcfc9d50c7e478a6d5e31e7b12282ce075cca6a0660ffedb: Status 404 returned error can't find the container with id 2729c06912bcaadbfcfc9d50c7e478a6d5e31e7b12282ce075cca6a0660ffedb
Oct 30 07:26:06.236634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.236599    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:06.236741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.236668    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:06.236741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.236702    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:06.247901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.247646    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:06.247901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.247694    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:06.648269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.648224    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" event={"ID":"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23","Type":"ContainerStarted","Data":"71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"}
Oct 30 07:26:06.648488 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.648304    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" event={"ID":"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23","Type":"ContainerStarted","Data":"2729c06912bcaadbfcfc9d50c7e478a6d5e31e7b12282ce075cca6a0660ffedb"}
Oct 30 07:26:06.692877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.684178    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:26:06.692877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.685517    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:26:06.692877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.690088    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:26:06.712992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.699338    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podStartSLOduration=1.699320299 podStartE2EDuration="1.699320299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:06.699155322 +0000 UTC m=+1769.407035492" watchObservedRunningTime="2026-10-30 07:26:06.699320299 +0000 UTC m=+1769.407200469"
Oct 30 07:26:06.814876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:06.814666    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:07.246842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:07.246803    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:07.247391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:07.246895    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:07.820473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:07.820165    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:08.246750 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:08.246689    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:08.246993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:08.246786    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:08.664215 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:08.664179    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:08.665294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:08.665267    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:26:09.246669 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:09.246630    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:09.246843 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:09.246729    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:10.247097 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:10.247050    5073 patch_prober.go:29] interesting pod/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 07:26:10.247630 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:10.247119    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 07:26:11.633516 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:11.633485    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:11.634747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:11.634713    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:11.635345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:11.635321    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:26:13.958400 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:26:13.958365    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:26:19.899503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:19.899469    5073 generic.go:356] "Generic (PLEG): container finished" podID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerID="4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f" exitCode=0
Oct 30 07:26:19.899971 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:19.899549    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" event={"ID":"b6b27249-97a4-4973-9dc6-5ccb7696e7b0","Type":"ContainerDied","Data":"4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"}
Oct 30 07:26:19.900071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:19.900056    5073 scope.go:122] "RemoveContainer" containerID="4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"
Oct 30 07:26:19.901708 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:19.901681    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:19.901787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:19.901746    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:19.901787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:19.901777    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:20.918614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:20.918577    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" event={"ID":"b6b27249-97a4-4973-9dc6-5ccb7696e7b0","Type":"ContainerStarted","Data":"779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05"}
Oct 30 07:26:21.779233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:21.779150    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:26:21.791876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:21.791779    5073 patch_prober.go:29] interesting pod/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 30 07:26:21.792377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:21.792088    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 30 07:26:22.820875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:22.777381    5073 patch_prober.go:29] interesting pod/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 30 07:26:22.821626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:22.821582    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 30 07:26:23.777878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:23.777765    5073 patch_prober.go:29] interesting pod/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 30 07:26:23.777878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:23.777843    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 30 07:26:24.314186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.314138    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"]
Oct 30 07:26:24.319911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.319886    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.340249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.340219    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"]
Oct 30 07:26:24.344801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.344783    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.346425 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.346400    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-265384-openshift-default-dockercfg-tcbq7\""
Oct 30 07:26:24.351143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.351120    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"]
Oct 30 07:26:24.427365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.427325    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"]
Oct 30 07:26:24.447977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.447942    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.447999    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sbzl\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448038    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448088    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448245    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448288    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448318    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448348    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhdrq\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448380    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448418    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448494    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448552    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448775 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448644    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448775 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448699    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.448894 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448778    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.448983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.448964    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.449046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.449002    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.449046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.449029    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.550400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.550364    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.550666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.550643    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.550839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.550821    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.551069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.551050    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.551374 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.551180    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.551521 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.551501    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.551679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.551660    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.551811 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.551794    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sbzl\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.551957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.551941    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.552093 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.552078    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.552227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.552211    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.554608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.554583    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.554773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.554754    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.554930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.554910    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhdrq\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.555105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555084    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.555229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555212    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.555358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555343    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.555464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555448    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.555682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555641    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.555769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555717    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.556025 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.556000    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.556106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.554955    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.556293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.556275    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.556624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.554016    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.556718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.554316    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.556819 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.553739    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.556973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.555402    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.557498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.557466    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.557899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.557831    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.560272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.560243    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.562028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.561960    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.563345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.563319    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.622903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.621609    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sbzl\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.626786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.626754    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.630766 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.630546    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhdrq\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.631310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.631288    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.635345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.635323    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:24.726954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.725101    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:24.779873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.779231    5073 patch_prober.go:29] interesting pod/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 30 07:26:24.779873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:24.779304    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 30 07:26:25.036933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.023037    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"]
Oct 30 07:26:25.065870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.065801    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:25.066900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.066843    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:25.067168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.067133    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:25.174293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.174161    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" event={"ID":"6d0721c6-5ad3-401e-befd-b9133fb493a7","Type":"ContainerStarted","Data":"dcd582d3ca72dd1582828ed35d40a04b003beed4ddb9b7b332685236a4aafd86"}
Oct 30 07:26:25.185252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.184107    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:26:25.332522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.332498    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"]
Oct 30 07:26:25.336287 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:26:25.336257    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa4b615_5135_4383_a4f2_6f8158543704.slice/crio-0f440da42f75c30b280e0f6080291c1e0d3bb2f6a3ab22ecdd14e593a88df4a5 WatchSource:0}: Error finding container 0f440da42f75c30b280e0f6080291c1e0d3bb2f6a3ab22ecdd14e593a88df4a5: Status 404 returned error can't find the container with id 0f440da42f75c30b280e0f6080291c1e0d3bb2f6a3ab22ecdd14e593a88df4a5
Oct 30 07:26:25.339059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.339027    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:25.339142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.339095    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:25.339142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.339126    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:25.795877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.777808    5073 patch_prober.go:29] interesting pod/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 30 07:26:25.795877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:25.777883    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 30 07:26:26.201878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.201685    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" event={"ID":"6d0721c6-5ad3-401e-befd-b9133fb493a7","Type":"ContainerStarted","Data":"3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2"}
Oct 30 07:26:26.206874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.205002    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" event={"ID":"5aa4b615-5135-4383-a4f2-6f8158543704","Type":"ContainerStarted","Data":"5356606c9e1a94b3f04bfb070ff92d37c14546e0774f71c68f869aa1f87a64f6"}
Oct 30 07:26:26.206874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.205067    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" event={"ID":"5aa4b615-5135-4383-a4f2-6f8158543704","Type":"ContainerStarted","Data":"0f440da42f75c30b280e0f6080291c1e0d3bb2f6a3ab22ecdd14e593a88df4a5"}
Oct 30 07:26:26.250509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.250450    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podStartSLOduration=2.250436473 podStartE2EDuration="2.250436473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:26.247992193 +0000 UTC m=+1788.955872362" watchObservedRunningTime="2026-10-30 07:26:26.250436473 +0000 UTC m=+1788.958316641"
Oct 30 07:26:26.315843 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.315774    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podStartSLOduration=2.3157549729999998 podStartE2EDuration="2.315754973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:26.314216159 +0000 UTC m=+1789.022096328" watchObservedRunningTime="2026-10-30 07:26:26.315754973 +0000 UTC m=+1789.023635142"
Oct 30 07:26:26.642796 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.642760    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:26.645872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.643479    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 07:26:26.646137 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.646105    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 07:26:26.727881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.727830    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:26.753047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.753008    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 07:26:26.753330 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.753282    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 07:26:26.852646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.852556    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:26:26.854028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:26.854002    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:26:27.637398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:27.637342    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 07:26:27.637624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:27.637470    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 07:26:27.747875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:27.735252    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 07:26:27.747875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:27.735320    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 07:26:28.643335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:28.643296    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 07:26:28.643616 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:28.643586    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 07:26:28.730402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:28.730364    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 07:26:28.730680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:28.730639    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 07:26:29.637178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:29.637141    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 07:26:29.645985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:29.645951    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 07:26:29.729565 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:29.729529    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 07:26:29.729862 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:29.729821    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 07:26:30.660876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:30.660492    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 07:26:30.660876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:30.660555    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 07:26:30.799495 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:30.799040    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 07:26:30.799495 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:30.799102    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 07:26:31.636480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:31.636434    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused" start-of-body=
Oct 30 07:26:31.636670 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:31.636513    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.142:15021/healthz/ready\": dial tcp 10.132.0.142:15021: connect: connection refused"
Oct 30 07:26:31.735392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:31.735348    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused" start-of-body=
Oct 30 07:26:31.735918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:31.735432    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.143:15021/healthz/ready\": dial tcp 10.132.0.143:15021: connect: connection refused"
Oct 30 07:26:32.642222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:32.642186    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:32.642711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:32.642676    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:32.643457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:32.643432    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:26:32.904815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:32.904732    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:32.906478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:32.906407    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:32.928172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:32.928139    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:26:37.917610 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:37.917578    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:26:37.923135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:37.923097    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:26:41.502792 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.502753    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"]
Oct 30 07:26:41.509263 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.509242    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.531884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.531842    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"]
Oct 30 07:26:41.538690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.538664    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-06e19a-serving-cert\""
Oct 30 07:26:41.617589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.617559    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.617751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.617704    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.617794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.617749    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5p6\" (UniqueName: \"kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.617927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.617904    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.718918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.718882    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.719113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.718960    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv5p6\" (UniqueName: \"kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.719113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.719054    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.719275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.719244    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.720103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.720070    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.721602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.721578    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.721705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.721660    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.775116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.775034    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv5p6\" (UniqueName: \"kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6\") pod \"maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:41.833244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:41.832945    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:42.155158 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:26:42.155124    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec7a1d4_269e_43f9_884a_6e505aee95a8.slice/crio-0b99bdb70663bb5a1d72e8c958bf0d8fd4ee54e477fa99f61e838c457a3fe541 WatchSource:0}: Error finding container 0b99bdb70663bb5a1d72e8c958bf0d8fd4ee54e477fa99f61e838c457a3fe541: Status 404 returned error can't find the container with id 0b99bdb70663bb5a1d72e8c958bf0d8fd4ee54e477fa99f61e838c457a3fe541
Oct 30 07:26:42.155406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:42.155385    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"]
Oct 30 07:26:42.515182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:42.515152    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn" event={"ID":"5ec7a1d4-269e-43f9-884a-6e505aee95a8","Type":"ContainerStarted","Data":"0b99bdb70663bb5a1d72e8c958bf0d8fd4ee54e477fa99f61e838c457a3fe541"}
Oct 30 07:26:43.525431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:43.525386    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn" event={"ID":"5ec7a1d4-269e-43f9-884a-6e505aee95a8","Type":"ContainerStarted","Data":"b93bbd3e996bcd0a72531791dabf589ff78a1302967fbe1b3f5287d2ba82ad91"}
Oct 30 07:26:43.525902 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:43.525483    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:43.569346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:43.568267    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn" podStartSLOduration=2.281313663 podStartE2EDuration="2.568250557s" totalImagesPullingTime="286.936894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:43.565563895 +0000 UTC m=+1806.273444065" watchObservedRunningTime="2026-10-30 07:26:43.568250557 +0000 UTC m=+1806.276130726"
Oct 30 07:26:43.927993 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:26:43.927954    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:26:49.100325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.100285    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"]
Oct 30 07:26:49.106338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.106312    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.126690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.126657    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-137122-serving-cert\""
Oct 30 07:26:49.153181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.153150    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"]
Oct 30 07:26:49.168037 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.167872    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56gq5\" (UniqueName: \"kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.168037 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.167952    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.168260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.168066    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.168260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.168106    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.269766 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.269730    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56gq5\" (UniqueName: \"kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.269954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.269800    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.269954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.269924    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.270077 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.269960    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.270541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.270509    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.272698 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.272668    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.272831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.272725    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.293267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.293233    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56gq5\" (UniqueName: \"kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5\") pod \"maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.435998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.435955    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:49.576151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.575083    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 07:26:49.921237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:49.921209    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"]
Oct 30 07:26:49.924721 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:26:49.924686    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e64f24_1e24_46b6_a554_671fd4a040a2.slice/crio-23e4a44e0f6b53ef295c4a4550bf1dc94533582574446e973ef5531a0773331c WatchSource:0}: Error finding container 23e4a44e0f6b53ef295c4a4550bf1dc94533582574446e973ef5531a0773331c: Status 404 returned error can't find the container with id 23e4a44e0f6b53ef295c4a4550bf1dc94533582574446e973ef5531a0773331c
Oct 30 07:26:50.673873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:50.660082    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv" event={"ID":"86e64f24-1e24-46b6-a554-671fd4a040a2","Type":"ContainerStarted","Data":"ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1"}
Oct 30 07:26:50.673873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:50.660146    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv" event={"ID":"86e64f24-1e24-46b6-a554-671fd4a040a2","Type":"ContainerStarted","Data":"23e4a44e0f6b53ef295c4a4550bf1dc94533582574446e973ef5531a0773331c"}
Oct 30 07:26:50.673873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:50.661136    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:50.727751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:50.727546    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv" podStartSLOduration=1.37085622 podStartE2EDuration="1.727526916s" totalImagesPullingTime="356.670696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:50.715341942 +0000 UTC m=+1813.423222102" watchObservedRunningTime="2026-10-30 07:26:50.727526916 +0000 UTC m=+1813.435407088"
Oct 30 07:26:54.443756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.443716    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"]
Oct 30 07:26:54.453436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.453410    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.476898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.476823    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"]
Oct 30 07:26:54.564473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564438    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.564691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564509    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.564691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564594    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.564691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564622    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.564691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564650    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.564933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564693    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.564933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564844    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.565002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564939    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr569\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.565002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.564979    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666379 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666342    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666410    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666463    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666486    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666525    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666549    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666695    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666773    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr569\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.666870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.666832    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.667034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.667010    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.667154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.667126    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.667244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.667212    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.667376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.667276    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.667376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.667303    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.668939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.668910    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.669397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.669376    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.688694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.688668    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.689206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.689185    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr569\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569\") pod \"e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") " pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:54.775557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:54.775474    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:55.108079 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:26:55.108051    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb06e50_2da3_4e7c_ac11_396d297cb947.slice/crio-9f6152642861c5aef12ccb5110a5a895df6cf9f321011ca9eaffc1edf09487a9 WatchSource:0}: Error finding container 9f6152642861c5aef12ccb5110a5a895df6cf9f321011ca9eaffc1edf09487a9: Status 404 returned error can't find the container with id 9f6152642861c5aef12ccb5110a5a895df6cf9f321011ca9eaffc1edf09487a9
Oct 30 07:26:55.109578 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.109551    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"]
Oct 30 07:26:55.111265 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.111231    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:55.111364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.111298    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:55.111364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.111328    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:26:55.724996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.724888    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" event={"ID":"6bb06e50-2da3-4e7c-ac11-396d297cb947","Type":"ContainerStarted","Data":"6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f"}
Oct 30 07:26:55.725402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.725080    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" event={"ID":"6bb06e50-2da3-4e7c-ac11-396d297cb947","Type":"ContainerStarted","Data":"9f6152642861c5aef12ccb5110a5a895df6cf9f321011ca9eaffc1edf09487a9"}
Oct 30 07:26:55.803872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.801398    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:26:55.814279 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:55.814222    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podStartSLOduration=1.814209787 podStartE2EDuration="1.814209787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:26:55.801340967 +0000 UTC m=+1818.509221166" watchObservedRunningTime="2026-10-30 07:26:55.814209787 +0000 UTC m=+1818.522089956"
Oct 30 07:26:56.789875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:56.788984    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 07:26:56.789875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:56.789063    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 07:26:57.758931 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:57.749022    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 07:26:57.787880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:57.780394    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 07:26:57.787880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:57.780456    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 07:26:58.782875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:58.779370    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 07:26:58.782875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:58.779446    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 07:26:59.792875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:59.777124    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 07:26:59.792875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:26:59.777194    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 07:27:00.782980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:00.782939    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 07:27:00.783267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:00.783235    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 07:27:01.781138 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:01.781102    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:27:01.782148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:01.781498    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:27:01.782296 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:01.782275    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:27:13.935133 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:27:13.935093    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:27:16.600677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:16.600643    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"]
Oct 30 07:27:16.601482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:16.601429    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk" podUID="964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" containerName="maas-api" containerID="cri-o://e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a" gracePeriod=30
Oct 30 07:27:17.082565 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.082361    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:27:17.107872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.104643    5073 generic.go:356] "Generic (PLEG): container finished" podID="964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" containerID="e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a" exitCode=0
Oct 30 07:27:17.107872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.104783    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk" event={"ID":"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb","Type":"ContainerDied","Data":"e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a"}
Oct 30 07:27:17.107872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.104834    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk" event={"ID":"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb","Type":"ContainerDied","Data":"fae00209ea9a23ae22f5bdda017cfc307f1ca81d899636a710a335e6d6c07393"}
Oct 30 07:27:17.107872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.104882    5073 scope.go:122] "RemoveContainer" containerID="e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a"
Oct 30 07:27:17.107872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.105755    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"
Oct 30 07:27:17.111006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.110980    5073 generic.go:356] "Generic (PLEG): container finished" podID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerID="71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6" exitCode=0
Oct 30 07:27:17.111355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.111333    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" event={"ID":"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23","Type":"ContainerDied","Data":"71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"}
Oct 30 07:27:17.112000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.111956    5073 scope.go:122] "RemoveContainer" containerID="71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"
Oct 30 07:27:17.114389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.114357    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:27:17.117595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.117572    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:27:17.117761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.117743    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:27:17.129307 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.129285    5073 scope.go:122] "RemoveContainer" containerID="e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a"
Oct 30 07:27:17.129722 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:27:17.129587    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a\": container with ID starting with e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a not found: ID does not exist" containerID="e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a"
Oct 30 07:27:17.129722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.129618    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a"} err="failed to get container status \"e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a\": rpc error: code = NotFound desc = could not find container \"e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a\": container with ID starting with e5236fddf7bdbdd69e7341412445623f3503be44a00c0c2c555a892bbaa40a5a not found: ID does not exist"
Oct 30 07:27:17.246019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.245881    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs\") pod \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") "
Oct 30 07:27:17.246019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.245985    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls\") pod \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") "
Oct 30 07:27:17.246250 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.246101    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2\" (UniqueName: \"kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2\") pod \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") "
Oct 30 07:27:17.246366 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.246345    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca\") pod \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\" (UID: \"964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb\") "
Oct 30 07:27:17.256561 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.255189    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca" pod "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" (UID: "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:27:17.287283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.286828    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2" pod "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" (UID: "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb"). InnerVolumeSpecName "kube-api-access-hxtk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:27:17.300956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.300015    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls" pod "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" (UID: "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:27:17.305098 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.304067    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs" pod "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" (UID: "964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:27:17.349356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.349244    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:17.349356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.349279    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:17.349356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.349295    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxtk2\" (UniqueName: \"kubernetes.io/projected/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-kube-api-access-hxtk2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:17.349356 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.349308    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:17.536337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.535964    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"]
Oct 30 07:27:17.543382 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:17.541083    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04aede-587d5567-vvmwk"]
Oct 30 07:27:18.126178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:18.126143    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" event={"ID":"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23","Type":"ContainerStarted","Data":"5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4"}
Oct 30 07:27:18.804577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:18.804534    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:27:18.806296 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:18.806261    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 07:27:18.806530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:18.806499    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 07:27:19.425211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:19.425175    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" path="/var/lib/kubelet/pods/964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb/volumes"
Oct 30 07:27:19.804453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:19.804364    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 07:27:19.804453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:19.804434    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 07:27:20.804459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:20.804417    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 07:27:20.804892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:20.804487    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 07:27:21.818535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:21.818497    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 07:27:21.819159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:21.819127    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 07:27:22.807950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:22.806804    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 07:27:22.807950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:22.806930    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 07:27:23.665937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:23.663946    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:27:23.804438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:23.804394    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 07:27:23.804641 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:23.804474    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 07:27:24.809261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:24.809227    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:27:24.810253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:24.810226    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 07:27:25.532877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:25.532815    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"]
Oct 30 07:27:25.533349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:25.533318    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" containerID="cri-o://779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05" gracePeriod=30
Oct 30 07:27:26.697377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.697342    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"]
Oct 30 07:27:26.698342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.698320    5073 cpu_manager.go:414] "containerMap: removing container" podUID="964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" containerName="maas-api"
Oct 30 07:27:26.698342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.698342    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" containerName="maas-api"
Oct 30 07:27:26.698517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.698495    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="964b8e3d-a7ca-4794-8ba3-fbf4d4d13eeb" containerName="maas-api"
Oct 30 07:27:26.703906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.703881    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.726721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.726698    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f84d9e-openshift-default-dockercfg-b5whr\""
Oct 30 07:27:26.747989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.747961    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"]
Oct 30 07:27:26.793628 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.793593    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.793791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.793636    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.793883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.793818    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2zg\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.794006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.793981    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.794076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.794058    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.794137 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.794111    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.794256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.794240    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.794323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.794306    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.794442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.794418    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.925923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.925807    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.928959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.928929    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.940802 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.940772    5073 patch_prober.go:29] interesting pod/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:27:26.941084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.941054    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.944944    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945019    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945148    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945249    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945335    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945411    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945437    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.950914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.945613    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2zg\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.952906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.951791    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.952906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.952093    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.952906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.952838    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.953895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.953847    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:26.995877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:26.995213    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:27.004874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.004471    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:27.042934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.041015    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:27.042934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.041656    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2zg\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg\") pod \"e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") " pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:27.340586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.340157    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:27.680146 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:27:27.680107    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8429e2_b233_48f1_b41e_f888cef78bac.slice/crio-b1f49db01bbddb0826f978b4a5e833a2f1c28870edd36377cb237e82a109bd96 WatchSource:0}: Error finding container b1f49db01bbddb0826f978b4a5e833a2f1c28870edd36377cb237e82a109bd96: Status 404 returned error can't find the container with id b1f49db01bbddb0826f978b4a5e833a2f1c28870edd36377cb237e82a109bd96
Oct 30 07:27:27.680993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.680820    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"]
Oct 30 07:27:27.684474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.684054    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:27:27.684474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.684140    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:27:27.684474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:27.684180    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:27:28.295523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:28.295483    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" event={"ID":"2f8429e2-b233-48f1-b41e-f888cef78bac","Type":"ContainerStarted","Data":"eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"}
Oct 30 07:27:28.296031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:28.295549    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" event={"ID":"2f8429e2-b233-48f1-b41e-f888cef78bac","Type":"ContainerStarted","Data":"b1f49db01bbddb0826f978b4a5e833a2f1c28870edd36377cb237e82a109bd96"}
Oct 30 07:27:28.340384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:28.340354    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:28.346668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:28.346642    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:28.348546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:28.348501    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podStartSLOduration=2.348486988 podStartE2EDuration="2.348486988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:27:28.345391415 +0000 UTC m=+1851.053271606" watchObservedRunningTime="2026-10-30 07:27:28.348486988 +0000 UTC m=+1851.056367157"
Oct 30 07:27:29.302499 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:29.302458    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:29.303410 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:29.303390    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:27:30.837016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.836985    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:27:30.937984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.937950    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938078    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938137    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938235    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938286    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938347    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938433    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938469    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.938567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.938537    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs\") pod \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\" (UID: \"b6b27249-97a4-4973-9dc6-5ccb7696e7b0\") "
Oct 30 07:27:30.939558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.939519    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:27:30.939826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.939806    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:27:30.940081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.940062    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:27:30.940232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.940217    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:27:30.940390 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.940374    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:27:30.942901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.942871    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:27:30.943502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.943465    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "kube-api-access-4dp8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:27:30.949372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.949219    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:27:30.950885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:30.950838    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy" pod "b6b27249-97a4-4973-9dc6-5ccb7696e7b0" (UID: "b6b27249-97a4-4973-9dc6-5ccb7696e7b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:27:31.040786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040750    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.040786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040782    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.040786 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040793    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.041046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040801    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.041046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040809    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.041046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040816    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.041046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040825    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.041046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040832    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.041046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.040841    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dp8p\" (UniqueName: \"kubernetes.io/projected/b6b27249-97a4-4973-9dc6-5ccb7696e7b0-kube-api-access-4dp8p\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:27:31.319202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.319163    5073 generic.go:356] "Generic (PLEG): container finished" podID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerID="779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05" exitCode=0
Oct 30 07:27:31.319380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.319244    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" event={"ID":"b6b27249-97a4-4973-9dc6-5ccb7696e7b0","Type":"ContainerDied","Data":"779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05"}
Oct 30 07:27:31.319380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.319329    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t" event={"ID":"b6b27249-97a4-4973-9dc6-5ccb7696e7b0","Type":"ContainerDied","Data":"b66a0317f502bc851cafb6bfba6ffa8f6bf992609e9029081a5093d20903d510"}
Oct 30 07:27:31.319380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.319248    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"
Oct 30 07:27:31.319380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.319358    5073 scope.go:122] "RemoveContainer" containerID="779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05"
Oct 30 07:27:31.331068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.331048    5073 scope.go:122] "RemoveContainer" containerID="4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"
Oct 30 07:27:31.340972 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.340943    5073 scope.go:122] "RemoveContainer" containerID="779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05"
Oct 30 07:27:31.341265 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:27:31.341238    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05\": container with ID starting with 779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05 not found: ID does not exist" containerID="779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05"
Oct 30 07:27:31.341334 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.341280    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05"} err="failed to get container status \"779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05\": rpc error: code = NotFound desc = could not find container \"779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05\": container with ID starting with 779c831f95e926c92fabc639565132a138e8dc28566ca6aebde3e0f43b58bb05 not found: ID does not exist"
Oct 30 07:27:31.341334 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.341304    5073 scope.go:122] "RemoveContainer" containerID="4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"
Oct 30 07:27:31.341567 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:27:31.341545    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f\": container with ID starting with 4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f not found: ID does not exist" containerID="4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"
Oct 30 07:27:31.341621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.341574    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f"} err="failed to get container status \"4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f\": rpc error: code = NotFound desc = could not find container \"4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f\": container with ID starting with 4acf90da1802dfb76bfdf3860fb2d2a058f9ad5adc071428557908d5c9d27c0f not found: ID does not exist"
Oct 30 07:27:31.375492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.375461    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"]
Oct 30 07:27:31.385773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.385744    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-04aede-openshift-default-6d56d6b7fc-mrl4t"]
Oct 30 07:27:31.425484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:31.425452    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" path="/var/lib/kubelet/pods/b6b27249-97a4-4973-9dc6-5ccb7696e7b0/volumes"
Oct 30 07:27:43.924423 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:27:43.924387    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:27:57.945047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:57.945010    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"]
Oct 30 07:27:57.945739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:57.945723    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy"
Oct 30 07:27:57.945785 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:57.945740    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy"
Oct 30 07:27:57.945954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:57.945941    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy"
Oct 30 07:27:57.951866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:57.951836    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.021563 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.020487    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-f84d9e-serving-cert\""
Oct 30 07:27:58.028526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.028498    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"]
Oct 30 07:27:58.122337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.122296    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.122545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.122472    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh55k\" (UniqueName: \"kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.122545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.122512    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.122665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.122592    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.228422 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.228314    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.228610 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.228442    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh55k\" (UniqueName: \"kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.228610 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.228473    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.228610 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.228513    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.235458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.235384    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.243708 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.243677    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.247351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.247320    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.261706 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.261676    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh55k\" (UniqueName: \"kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k\") pod \"maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.269275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.269248    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:58.579583 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:27:58.579538    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f931f9b_1e7b_4c19_85b0_4fbeaba6c4f7.slice/crio-c2585501e654654f5fa44730f0928c7b6a1af4ac734291a8fb8e5a54652bc7d4 WatchSource:0}: Error finding container c2585501e654654f5fa44730f0928c7b6a1af4ac734291a8fb8e5a54652bc7d4: Status 404 returned error can't find the container with id c2585501e654654f5fa44730f0928c7b6a1af4ac734291a8fb8e5a54652bc7d4
Oct 30 07:27:58.581426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.581395    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"]
Oct 30 07:27:58.708251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:58.708215    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" event={"ID":"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7","Type":"ContainerStarted","Data":"c2585501e654654f5fa44730f0928c7b6a1af4ac734291a8fb8e5a54652bc7d4"}
Oct 30 07:27:59.719746 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:59.719692    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" event={"ID":"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7","Type":"ContainerStarted","Data":"a6ce5db383090318a25ddd26d04f817268a2e2de8e1aff7e23b32e3b08019713"}
Oct 30 07:27:59.720258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:59.719796    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:27:59.765735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:27:59.765681    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" podStartSLOduration=2.3991931380000002 podStartE2EDuration="2.765668429s" totalImagesPullingTime="366.475291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:27:59.762065153 +0000 UTC m=+1882.469945321" watchObservedRunningTime="2026-10-30 07:27:59.765668429 +0000 UTC m=+1882.473548598"
Oct 30 07:28:05.734173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:05.734136    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:28:13.924234 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:28:13.924185    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:28:30.343997 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.343957    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:28:30.344448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.344028    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:28:30.484255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.484219    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"]
Oct 30 07:28:30.485430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.485403    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy"
Oct 30 07:28:30.485835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.485809    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy"
Oct 30 07:28:30.486083 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.486064    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6b27249-97a4-4973-9dc6-5ccb7696e7b0" containerName="istio-proxy"
Oct 30 07:28:30.492796 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.490056    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.512119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.511164    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-137122\"/\"openshift-service-ca.crt\""
Oct 30 07:28:30.512119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.511344    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-137122\"/\"kube-root-ca.crt\""
Oct 30 07:28:30.512119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.511978    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-137122\"/\"auth-test-model-137122-kserve-self-signed-certs\""
Oct 30 07:28:30.512119 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.512081    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-137122\"/\"default-dockercfg-hfdg8\""
Oct 30 07:28:30.522767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.522739    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"]
Oct 30 07:28:30.572468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.572399    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.572636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.572529    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.572636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.572584    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.572753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.572736    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.572832 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.572809    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hztg\" (UniqueName: \"kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.573298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.573272    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675197    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675429 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675277    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hztg\" (UniqueName: \"kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675429 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675357    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675454    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675526    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675572    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675638    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.675965 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.675945    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.676364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.676328    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.678158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.678134    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.678916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.678891    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.698732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.698696    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hztg\" (UniqueName: \"kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg\") pod \"auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") " pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:30.826643 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:30.826606    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:31.213382 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:28:31.213310    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf774e9a_0480_4526_8065_cb33abc8cfe6.slice/crio-0af1be8f4737d55181281b36b3f4e8265aec2a8735e3ad82519b28f973727ac3 WatchSource:0}: Error finding container 0af1be8f4737d55181281b36b3f4e8265aec2a8735e3ad82519b28f973727ac3: Status 404 returned error can't find the container with id 0af1be8f4737d55181281b36b3f4e8265aec2a8735e3ad82519b28f973727ac3
Oct 30 07:28:31.214289 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:31.214261    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"]
Oct 30 07:28:32.249876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.245114    5073 generic.go:356] "Generic (PLEG): container finished" podID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerID="eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e" exitCode=0
Oct 30 07:28:32.249876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.245272    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" event={"ID":"2f8429e2-b233-48f1-b41e-f888cef78bac","Type":"ContainerDied","Data":"eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"}
Oct 30 07:28:32.249876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.246283    5073 scope.go:122] "RemoveContainer" containerID="eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"
Oct 30 07:28:32.268958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.254582    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:28:32.268958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.254689    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:28:32.268958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.254740    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:28:32.274700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.274616    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" event={"ID":"af774e9a-0480-4526-8065-cb33abc8cfe6","Type":"ContainerStarted","Data":"cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76"}
Oct 30 07:28:32.274700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.274675    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" event={"ID":"af774e9a-0480-4526-8065-cb33abc8cfe6","Type":"ContainerStarted","Data":"0af1be8f4737d55181281b36b3f4e8265aec2a8735e3ad82519b28f973727ac3"}
Oct 30 07:28:32.352908 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.351660    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" podStartSLOduration=2.351641566 podStartE2EDuration="2.351641566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:28:32.34574307 +0000 UTC m=+1915.053623278" watchObservedRunningTime="2026-10-30 07:28:32.351641566 +0000 UTC m=+1915.059521737"
Oct 30 07:28:32.827456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:32.827420    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:33.294056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:33.294015    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" event={"ID":"2f8429e2-b233-48f1-b41e-f888cef78bac","Type":"ContainerStarted","Data":"45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c"}
Oct 30 07:28:33.341924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:33.341136    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:28:33.341924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:33.341512    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused" start-of-body=
Oct 30 07:28:33.341924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:33.341571    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused"
Oct 30 07:28:34.341099 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:34.341065    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused" start-of-body=
Oct 30 07:28:34.341606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:34.341120    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused"
Oct 30 07:28:35.341454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:35.341419    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused" start-of-body=
Oct 30 07:28:35.341875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:35.341482    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused"
Oct 30 07:28:36.341050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:36.341009    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused" start-of-body=
Oct 30 07:28:36.341254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:36.341072    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused"
Oct 30 07:28:37.340491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:37.340456    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused" start-of-body=
Oct 30 07:28:37.340928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:37.340510    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused"
Oct 30 07:28:38.340728 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:38.340694    5073 patch_prober.go:29] interesting pod/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused" start-of-body=
Oct 30 07:28:38.341191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:38.340757    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.147:15021/healthz/ready\": dial tcp 10.132.0.147:15021: connect: connection refused"
Oct 30 07:28:39.344511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:39.344483    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:28:39.345016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:39.344995    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:28:39.345650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:39.345633    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:28:40.827681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:40.827639    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:40.841735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:40.841707    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:41.385709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:28:41.385678    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:28:43.922036 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:28:43.921995    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:29:13.923116 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:13.923031    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:29:25.632449 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:25.632410    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"]
Oct 30 07:29:25.633103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:25.632668    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" podUID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" containerName="maas-api" containerID="cri-o://a6ce5db383090318a25ddd26d04f817268a2e2de8e1aff7e23b32e3b08019713" gracePeriod=30
Oct 30 07:29:25.728788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:25.728740    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" podUID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.148:8443/health\": dial tcp 10.132.0.148:8443: connect: connection refused"
Oct 30 07:29:25.782286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:25.782253    5073 generic.go:356] "Generic (PLEG): container finished" podID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" containerID="a6ce5db383090318a25ddd26d04f817268a2e2de8e1aff7e23b32e3b08019713" exitCode=0
Oct 30 07:29:25.782466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:25.782414    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" event={"ID":"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7","Type":"ContainerDied","Data":"a6ce5db383090318a25ddd26d04f817268a2e2de8e1aff7e23b32e3b08019713"}
Oct 30 07:29:26.165095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.164480    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:29:26.321987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.318326    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k\" (UniqueName: \"kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k\") pod \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") "
Oct 30 07:29:26.321987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.318642    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca\") pod \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") "
Oct 30 07:29:26.321987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.318717    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs\") pod \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") "
Oct 30 07:29:26.321987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.318792    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls\") pod \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\" (UID: \"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7\") "
Oct 30 07:29:26.345475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.345011    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca" pod "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" (UID: "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:29:26.359308 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.359236    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs" pod "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" (UID: "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:29:26.365945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.365889    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls" pod "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" (UID: "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:29:26.407615 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.407563    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k" pod "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" (UID: "7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7"). InnerVolumeSpecName "kube-api-access-bh55k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:26.419621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.419571    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"]
Oct 30 07:29:26.420637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.420392    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy" containerID="cri-o://b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239" gracePeriod=30
Oct 30 07:29:26.454605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.454499    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:26.454605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.454540    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:26.454605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.454555    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:26.454605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.454568    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh55k\" (UniqueName: \"kubernetes.io/projected/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7-kube-api-access-bh55k\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:26.791679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.791647    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"
Oct 30 07:29:26.792198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.791648    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j" event={"ID":"7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7","Type":"ContainerDied","Data":"c2585501e654654f5fa44730f0928c7b6a1af4ac734291a8fb8e5a54652bc7d4"}
Oct 30 07:29:26.792198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.791789    5073 scope.go:122] "RemoveContainer" containerID="a6ce5db383090318a25ddd26d04f817268a2e2de8e1aff7e23b32e3b08019713"
Oct 30 07:29:26.842836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.842797    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"]
Oct 30 07:29:26.854134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:26.854103    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f84d9e-7bd7f4c9cc-t8x7j"]
Oct 30 07:29:27.424678 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:27.424645    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" path="/var/lib/kubelet/pods/7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7/volumes"
Oct 30 07:29:31.782272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.782199    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:29:31.834472 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.834433    5073 generic.go:356] "Generic (PLEG): container finished" podID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerID="b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239" exitCode=0
Oct 30 07:29:31.834659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.834482    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" event={"ID":"9b7b1505-6afc-4b76-abf4-03784f23f292","Type":"ContainerDied","Data":"b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239"}
Oct 30 07:29:31.834746 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.834496    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"
Oct 30 07:29:31.834956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.834893    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m" event={"ID":"9b7b1505-6afc-4b76-abf4-03784f23f292","Type":"ContainerDied","Data":"0dfa9cb9f9830d928f9983ff6d102e8ed9c334d2068cfd44595b8c36abd0f7c8"}
Oct 30 07:29:31.834956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.834921    5073 scope.go:122] "RemoveContainer" containerID="b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239"
Oct 30 07:29:31.848192 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848162    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848269    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848320    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848394    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848463    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848527 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848488    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848641 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848612    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848696    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848815    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy\") pod \"9b7b1505-6afc-4b76-abf4-03784f23f292\" (UID: \"9b7b1505-6afc-4b76-abf4-03784f23f292\") "
Oct 30 07:29:31.848951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.848830    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:31.849149 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849095    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:29:31.849226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849184    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:31.849509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849488    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:31.849736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849716    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b7b1505-6afc-4b76-abf4-03784f23f292-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.849808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849740    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.849808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849754    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.849808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849766    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.849808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.849780    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:31.862664 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.862637    5073 scope.go:122] "RemoveContainer" containerID="b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239"
Oct 30 07:29:31.863198 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:31.863167    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239\": container with ID starting with b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239 not found: ID does not exist" containerID="b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239"
Oct 30 07:29:31.863316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.863211    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239"} err="failed to get container status \"b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239\": rpc error: code = NotFound desc = could not find container \"b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239\": container with ID starting with b702ce17fb5b915d82e79fe6c2a484cf68d32411c98bb23507640a45d3f22239 not found: ID does not exist"
Oct 30 07:29:31.863899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.863841    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:31.884951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.884048    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "kube-api-access-glbwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:31.884951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.884126    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:29:31.884951 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.884205    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token" pod "9b7b1505-6afc-4b76-abf4-03784f23f292" (UID: "9b7b1505-6afc-4b76-abf4-03784f23f292"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:31.951805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.951770    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.951805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.951800    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.951805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.951810    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b7b1505-6afc-4b76-abf4-03784f23f292-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.952065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.951822    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glbwd\" (UniqueName: \"kubernetes.io/projected/9b7b1505-6afc-4b76-abf4-03784f23f292-kube-api-access-glbwd\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:31.952065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:31.951831    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b7b1505-6afc-4b76-abf4-03784f23f292-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:32.231320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:32.231281    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"]
Oct 30 07:29:32.272871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:32.257219    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6cm4m"]
Oct 30 07:29:33.424049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:33.424018    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" path="/var/lib/kubelet/pods/9b7b1505-6afc-4b76-abf4-03784f23f292/volumes"
Oct 30 07:29:33.953581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:33.953548    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"]
Oct 30 07:29:33.953831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:33.953799    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy" containerID="cri-o://45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c" gracePeriod=30
Oct 30 07:29:34.633924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.633877    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7439-490360"]
Oct 30 07:29:34.634633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.634614    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy"
Oct 30 07:29:34.634633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.634632    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy"
Oct 30 07:29:34.634765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.634663    5073 cpu_manager.go:414] "containerMap: removing container" podUID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" containerName="maas-api"
Oct 30 07:29:34.634765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.634668    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" containerName="maas-api"
Oct 30 07:29:34.634829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.634783    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b7b1505-6afc-4b76-abf4-03784f23f292" containerName="istio-proxy"
Oct 30 07:29:34.634829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.634796    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f931f9b-1e7b-4c19-85b0-4fbeaba6c4f7" containerName="maas-api"
Oct 30 07:29:34.639986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.639964    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:34.658272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.658244    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7439-490360"]
Oct 30 07:29:34.665169 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.665142    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5q8j4\""
Oct 30 07:29:34.745503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.745455    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmk2\" (UniqueName: \"kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2\") pod \"test-curl-7439-490360\" (UID: \"1870f756-113c-4640-96e5-94daecae5992\") " pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:34.846976 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.846921    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmk2\" (UniqueName: \"kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2\") pod \"test-curl-7439-490360\" (UID: \"1870f756-113c-4640-96e5-94daecae5992\") " pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:34.869665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.869633    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmk2\" (UniqueName: \"kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2\") pod \"test-curl-7439-490360\" (UID: \"1870f756-113c-4640-96e5-94daecae5992\") " pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:34.954127 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:34.954036    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:35.311013 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:29:35.310838    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1870f756_113c_4640_96e5_94daecae5992.slice/crio-b7d0e147b56f812778e1ab9c4f19bebc9f2a88392921e7f7bf5cd9efb49c4fc5 WatchSource:0}: Error finding container b7d0e147b56f812778e1ab9c4f19bebc9f2a88392921e7f7bf5cd9efb49c4fc5: Status 404 returned error can't find the container with id b7d0e147b56f812778e1ab9c4f19bebc9f2a88392921e7f7bf5cd9efb49c4fc5
Oct 30 07:29:35.311703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:35.311673    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7439-490360"]
Oct 30 07:29:35.865068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:35.865023    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7439-490360" event={"ID":"1870f756-113c-4640-96e5-94daecae5992","Type":"ContainerStarted","Data":"b7d0e147b56f812778e1ab9c4f19bebc9f2a88392921e7f7bf5cd9efb49c4fc5"}
Oct 30 07:29:36.875464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:36.875429    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7439-490360" event={"ID":"1870f756-113c-4640-96e5-94daecae5992","Type":"ContainerStarted","Data":"5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf"}
Oct 30 07:29:36.913718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:36.913656    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7439-490360" podStartSLOduration=2.218760072 podStartE2EDuration="2.913641814s" totalImagesPullingTime="694.881742ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:29:36.910536865 +0000 UTC m=+1979.618417034" watchObservedRunningTime="2026-10-30 07:29:36.913641814 +0000 UTC m=+1979.621521983"
Oct 30 07:29:37.847979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:37.847945    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7439-490360"]
Oct 30 07:29:37.852594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:37.852562    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7439-490360"]
Oct 30 07:29:38.010022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.009987    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7439-101d06"]
Oct 30 07:29:38.010830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.010807    5073 cpu_manager.go:414] "containerMap: removing container" podUID="1870f756-113c-4640-96e5-94daecae5992" containerName="test-curl-7439-490360"
Oct 30 07:29:38.010830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.010831    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1870f756-113c-4640-96e5-94daecae5992" containerName="test-curl-7439-490360"
Oct 30 07:29:38.011074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.011064    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="1870f756-113c-4640-96e5-94daecae5992" containerName="test-curl-7439-490360"
Oct 30 07:29:38.015341 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.015324    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:38.036462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.036427    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvlfg\" (UniqueName: \"kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg\") pod \"test-curl-7439-101d06\" (UID: \"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811\") " pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:38.037257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.037233    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7439-101d06"]
Oct 30 07:29:38.138362 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.138324    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvlfg\" (UniqueName: \"kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg\") pod \"test-curl-7439-101d06\" (UID: \"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811\") " pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:38.161224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.161192    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvlfg\" (UniqueName: \"kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg\") pod \"test-curl-7439-101d06\" (UID: \"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811\") " pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:38.329252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.329213    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:38.646508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.646483    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7439-101d06"]
Oct 30 07:29:38.894747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.894655    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7439-101d06" event={"ID":"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811","Type":"ContainerStarted","Data":"5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713"}
Oct 30 07:29:38.894747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.894707    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7439-101d06" event={"ID":"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811","Type":"ContainerStarted","Data":"69fff2ce392384765dc43b44344fbe530a72ba24fcd798b4af4f21c5953bdffc"}
Oct 30 07:29:38.894960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.894938    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7439-490360" podUID="1870f756-113c-4640-96e5-94daecae5992" containerName="test-curl-7439-490360" containerID="cri-o://5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf" gracePeriod=2
Oct 30 07:29:38.934343 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:38.934287    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7439-101d06" podStartSLOduration=1.9342682180000002 podStartE2EDuration="1.934268218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:29:38.930726835 +0000 UTC m=+1981.638607028" watchObservedRunningTime="2026-10-30 07:29:38.934268218 +0000 UTC m=+1981.642148388"
Oct 30 07:29:38.943644 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:38.943612    5073 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7439-490360\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="1870f756-113c-4640-96e5-94daecae5992" pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:39.256522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.256494    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:29:39.269379 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:39.269346    5073 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7439-490360\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="1870f756-113c-4640-96e5-94daecae5992" pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:39.356548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356509    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.356748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356599    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.356748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356688    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.356748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356733    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.356949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356799    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.356949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356872    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.357061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.356971    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.357061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.357001    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.357061 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.357021    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:39.357224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.357167    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket\") pod \"2f8429e2-b233-48f1-b41e-f888cef78bac\" (UID: \"2f8429e2-b233-48f1-b41e-f888cef78bac\") "
Oct 30 07:29:39.357291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.357269    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:39.357385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.357360    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:29:39.360038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.359999    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:39.360747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.360715    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:39.361164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.361139    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:39.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.362490    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.362525    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.362539    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f8429e2-b233-48f1-b41e-f888cef78bac-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.362553    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.362567    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.362893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.362586    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.376657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.376629    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "kube-api-access-8d2zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:39.377618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.377595    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:29:39.378757 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.378584    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo" pod "2f8429e2-b233-48f1-b41e-f888cef78bac" (UID: "2f8429e2-b233-48f1-b41e-f888cef78bac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:29:39.465399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.465356    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d2zg\" (UniqueName: \"kubernetes.io/projected/2f8429e2-b233-48f1-b41e-f888cef78bac-kube-api-access-8d2zg\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.465600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.465545    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.465600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.465569    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f8429e2-b233-48f1-b41e-f888cef78bac-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:39.905822 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.905788    5073 generic.go:356] "Generic (PLEG): container finished" podID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerID="45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c" exitCode=0
Oct 30 07:29:39.906041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.905880    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"
Oct 30 07:29:39.906041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.905883    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" event={"ID":"2f8429e2-b233-48f1-b41e-f888cef78bac","Type":"ContainerDied","Data":"45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c"}
Oct 30 07:29:39.906041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.905951    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696" event={"ID":"2f8429e2-b233-48f1-b41e-f888cef78bac","Type":"ContainerDied","Data":"b1f49db01bbddb0826f978b4a5e833a2f1c28870edd36377cb237e82a109bd96"}
Oct 30 07:29:39.906041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.905981    5073 scope.go:122] "RemoveContainer" containerID="45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c"
Oct 30 07:29:39.906041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.906004    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7439-101d06"]
Oct 30 07:29:39.914465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.913907    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7439-101d06"]
Oct 30 07:29:39.920435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.920417    5073 scope.go:122] "RemoveContainer" containerID="eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"
Oct 30 07:29:39.932090 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.932068    5073 scope.go:122] "RemoveContainer" containerID="45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c"
Oct 30 07:29:39.932443 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:39.932419    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c\": container with ID starting with 45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c not found: ID does not exist" containerID="45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c"
Oct 30 07:29:39.932539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.932455    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c"} err="failed to get container status \"45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c\": rpc error: code = NotFound desc = could not find container \"45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c\": container with ID starting with 45ea7d8a0e049bbe98f18035e871bfaaba5f821f455dd1a663ebcfda6670d16c not found: ID does not exist"
Oct 30 07:29:39.932539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.932477    5073 scope.go:122] "RemoveContainer" containerID="eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"
Oct 30 07:29:39.932799 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:39.932770    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e\": container with ID starting with eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e not found: ID does not exist" containerID="eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"
Oct 30 07:29:39.932875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.932810    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e"} err="failed to get container status \"eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e\": rpc error: code = NotFound desc = could not find container \"eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e\": container with ID starting with eb9d8e9db509602ae2ce64d70a770853e8d450dd7430e67114d09e877ffc211e not found: ID does not exist"
Oct 30 07:29:39.969718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:39.969688    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"]
Oct 30 07:29:40.007654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:40.007624    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f84d9e-openshift-default-6bb5fd4f8f-47696"]
Oct 30 07:29:40.957846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:40.954942    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7439-101d06" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" containerName="test-curl-7439-101d06" containerID="cri-o://5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713" gracePeriod=2
Oct 30 07:29:40.976591 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:40.969094    5073 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7439-101d06\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:41.098120 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.098088    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"]
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099147    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099168    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099195    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099203    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099236    5073 cpu_manager.go:414] "containerMap: removing container" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" containerName="test-curl-7439-101d06"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099246    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" containerName="test-curl-7439-101d06"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099382    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy"
Oct 30 07:29:41.104592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.099398    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" containerName="test-curl-7439-101d06"
Oct 30 07:29:41.108961 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.108934    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.124690 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:41.122184    5073 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7439-101d06\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:41.141276 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.139065    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w4-a475d6-openshift-default-dockercfg-wjjfp\""
Oct 30 07:29:41.163043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.162977    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"]
Oct 30 07:29:41.225152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.224883    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.225152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.224934    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.225152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225050    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.225152 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225109    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjrj\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.237104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225188    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.237104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225217    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.237104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225267    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.237104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225340    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.237104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.225384    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.363639    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.363909    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.363946    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.364070    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.364162    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjrj\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.364234    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.364264    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.364320    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.364442    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.365079    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.366498    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.366827    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.367692    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.371941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.368070    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.394082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.385618    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:41.409898 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:41.406078    5073 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7439-101d06\" is forbidden: User \"system:node:ip-10-0-132-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-33.ec2.internal' and this object" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:41.419624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.419518    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjrj\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.422255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.421158    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.422255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.422193    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.424164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.423461    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token\") pod \"e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") " pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.450987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.441470    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:41.450987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.447804    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" path="/var/lib/kubelet/pods/2f8429e2-b233-48f1-b41e-f888cef78bac/volumes"
Oct 30 07:29:41.469954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.469911    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2\" (UniqueName: \"kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2\") pod \"1870f756-113c-4640-96e5-94daecae5992\" (UID: \"1870f756-113c-4640-96e5-94daecae5992\") "
Oct 30 07:29:41.531291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.531235    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2" pod "1870f756-113c-4640-96e5-94daecae5992" (UID: "1870f756-113c-4640-96e5-94daecae5992"). InnerVolumeSpecName "kube-api-access-xxmk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:41.574551 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.574514    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxmk2\" (UniqueName: \"kubernetes.io/projected/1870f756-113c-4640-96e5-94daecae5992-kube-api-access-xxmk2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:41.901888 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:29:41.901846    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c96d9c_7d64_4bb2_ade2_92d5a3fc283e.slice/crio-75b8e5425be0ff8a5d85fa2d1ce98183ac23b2a3dbd49e9443dd6731cbd7ec89 WatchSource:0}: Error finding container 75b8e5425be0ff8a5d85fa2d1ce98183ac23b2a3dbd49e9443dd6731cbd7ec89: Status 404 returned error can't find the container with id 75b8e5425be0ff8a5d85fa2d1ce98183ac23b2a3dbd49e9443dd6731cbd7ec89
Oct 30 07:29:41.902948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.902917    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"]
Oct 30 07:29:41.904607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.904574    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:29:41.904712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.904655    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:29:41.904712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.904700    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:29:41.965014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.964979    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" event={"ID":"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e","Type":"ContainerStarted","Data":"75b8e5425be0ff8a5d85fa2d1ce98183ac23b2a3dbd49e9443dd6731cbd7ec89"}
Oct 30 07:29:41.966491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.966465    5073 generic.go:356] "Generic (PLEG): container finished" podID="1870f756-113c-4640-96e5-94daecae5992" containerID="5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf" exitCode=137
Oct 30 07:29:41.966588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.966495    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-490360"
Oct 30 07:29:41.966588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.966564    5073 scope.go:122] "RemoveContainer" containerID="5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf"
Oct 30 07:29:41.983182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.983148    5073 scope.go:122] "RemoveContainer" containerID="5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf"
Oct 30 07:29:41.983488 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:41.983455    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf\": container with ID starting with 5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf not found: ID does not exist" containerID="5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf"
Oct 30 07:29:41.983663 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:41.983488    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf"} err="failed to get container status \"5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf\": rpc error: code = NotFound desc = could not find container \"5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf\": container with ID starting with 5f44418f3ec7fb72b65f06da1e4fac6f2828977924459dab475cf34b6a472cdf not found: ID does not exist"
Oct 30 07:29:42.979702 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:42.979665    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" event={"ID":"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e","Type":"ContainerStarted","Data":"9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"}
Oct 30 07:29:43.042535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.042473    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podStartSLOduration=2.042453533 podStartE2EDuration="2.042453533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:29:43.036114377 +0000 UTC m=+1985.743994545" watchObservedRunningTime="2026-10-30 07:29:43.042453533 +0000 UTC m=+1985.750333718"
Oct 30 07:29:43.283948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.283917    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:43.318288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.318257    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg\" (UniqueName: \"kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg\") pod \"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811\" (UID: \"1f5c2b8d-e280-4baf-b91e-e4a2cd16c811\") "
Oct 30 07:29:43.320414 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.320386    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg" pod "1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" (UID: "1f5c2b8d-e280-4baf-b91e-e4a2cd16c811"). InnerVolumeSpecName "kube-api-access-gvlfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:29:43.419581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.419551    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvlfg\" (UniqueName: \"kubernetes.io/projected/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811-kube-api-access-gvlfg\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:29:43.425294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.425262    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1870f756-113c-4640-96e5-94daecae5992" path="/var/lib/kubelet/pods/1870f756-113c-4640-96e5-94daecae5992/volumes"
Oct 30 07:29:43.425808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.425786    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" path="/var/lib/kubelet/pods/1f5c2b8d-e280-4baf-b91e-e4a2cd16c811/volumes"
Oct 30 07:29:43.442572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.442548    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:43.449311 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.449288    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:43.922103 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:43.922063    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:29:43.990887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.987511    5073 generic.go:356] "Generic (PLEG): container finished" podID="1f5c2b8d-e280-4baf-b91e-e4a2cd16c811" containerID="5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713" exitCode=137
Oct 30 07:29:43.990887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.987569    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7439-101d06"
Oct 30 07:29:43.990887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.987574    5073 scope.go:122] "RemoveContainer" containerID="5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713"
Oct 30 07:29:43.990887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.988125    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:43.990887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:43.989185    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:29:44.002290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:44.002126    5073 scope.go:122] "RemoveContainer" containerID="5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713"
Oct 30 07:29:44.002460 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:29:44.002437    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713\": container with ID starting with 5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713 not found: ID does not exist" containerID="5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713"
Oct 30 07:29:44.002531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:44.002471    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713"} err="failed to get container status \"5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713\": rpc error: code = NotFound desc = could not find container \"5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713\": container with ID starting with 5b137f17a7e991a923b81dec35de555ad5c77dedc9096458108243f8a8dbc713 not found: ID does not exist"
Oct 30 07:29:47.667876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.667687    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"]
Oct 30 07:29:47.692875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.669038    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f8429e2-b233-48f1-b41e-f888cef78bac" containerName="istio-proxy"
Oct 30 07:29:47.826620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.788097    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"]
Oct 30 07:29:47.826620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.788255    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:47.826620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.808059    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w4-a475d6\""
Oct 30 07:29:47.834764 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.827633    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w4-a475d6-dockercfg-zjzph\""
Oct 30 07:29:47.912797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.912756    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:47.913413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:47.913386    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4nb\" (UniqueName: \"kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb\") pod \"payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:48.015471 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:48.015374    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4nb\" (UniqueName: \"kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb\") pod \"payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:48.015634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:48.015543    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:48.016321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:48.016292    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:48.038208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:48.038181    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4nb\" (UniqueName: \"kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb\") pod \"payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:48.168624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:48.168592    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:48.476193 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:48.476160    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"]
Oct 30 07:29:48.476930 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:29:48.476899    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299c5545_17b6_4d86_b3de_84ef840a9228.slice/crio-b9e2c12df6bb8fb8755e0bf7d2abeab08087cb75c02fe9130af57e4f5aaab64c WatchSource:0}: Error finding container b9e2c12df6bb8fb8755e0bf7d2abeab08087cb75c02fe9130af57e4f5aaab64c: Status 404 returned error can't find the container with id b9e2c12df6bb8fb8755e0bf7d2abeab08087cb75c02fe9130af57e4f5aaab64c
Oct 30 07:29:49.047434 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:49.047400    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff" event={"ID":"299c5545-17b6-4d86-b3de-84ef840a9228","Type":"ContainerStarted","Data":"bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93"}
Oct 30 07:29:49.047829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:49.047455    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff" event={"ID":"299c5545-17b6-4d86-b3de-84ef840a9228","Type":"ContainerStarted","Data":"b9e2c12df6bb8fb8755e0bf7d2abeab08087cb75c02fe9130af57e4f5aaab64c"}
Oct 30 07:29:49.047829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:49.047677    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:29:49.091085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:29:49.091014    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff" podStartSLOduration=2.090995083 podStartE2EDuration="2.090995083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:29:49.08666073 +0000 UTC m=+1991.794540898" watchObservedRunningTime="2026-10-30 07:29:49.090995083 +0000 UTC m=+1991.798875250"
Oct 30 07:30:00.057681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.057641    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 07:30:00.303179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.303012    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"]
Oct 30 07:30:00.309079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.308643    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.328502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.326422    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"]
Oct 30 07:30:00.388686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.388642    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9pb7\""
Oct 30 07:30:00.429473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.429437    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.429695 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.429647    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhx4\" (UniqueName: \"kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.533878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.532216    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhx4\" (UniqueName: \"kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.533878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.532486    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.544881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.543911    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.564456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.562744    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhx4\" (UniqueName: \"kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.648365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.648308    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:00.979053 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:30:00.979016    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf6dffb_11d2_4bd3_a518_1002cdd491fb.slice/crio-5d65dc72da21296a9c0412088ad9e5ed717ec13d704fb86024171424aae6b383 WatchSource:0}: Error finding container 5d65dc72da21296a9c0412088ad9e5ed717ec13d704fb86024171424aae6b383: Status 404 returned error can't find the container with id 5d65dc72da21296a9c0412088ad9e5ed717ec13d704fb86024171424aae6b383
Oct 30 07:30:00.980632 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:00.980182    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"]
Oct 30 07:30:01.165361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:01.165325    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" event={"ID":"7cf6dffb-11d2-4bd3-a518-1002cdd491fb","Type":"ContainerStarted","Data":"5d65dc72da21296a9c0412088ad9e5ed717ec13d704fb86024171424aae6b383"}
Oct 30 07:30:04.198023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:04.197912    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" event={"ID":"7cf6dffb-11d2-4bd3-a518-1002cdd491fb","Type":"ContainerStarted","Data":"798b58f9173b292be95a1f083e8d192aa9f60ed30a6207f5f7c0625d62f5035d"}
Oct 30 07:30:04.236560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:04.236497    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" podStartSLOduration=1.743099559 podStartE2EDuration="4.236485055s" totalImagesPullingTime="2.493385496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:30:04.236310167 +0000 UTC m=+2006.944190363" watchObservedRunningTime="2026-10-30 07:30:04.236485055 +0000 UTC m=+2006.944365224"
Oct 30 07:30:05.208459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:05.208419    5073 generic.go:356] "Generic (PLEG): container finished" podID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerID="798b58f9173b292be95a1f083e8d192aa9f60ed30a6207f5f7c0625d62f5035d" exitCode=60
Oct 30 07:30:05.208912 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:05.208513    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" event={"ID":"7cf6dffb-11d2-4bd3-a518-1002cdd491fb","Type":"ContainerDied","Data":"798b58f9173b292be95a1f083e8d192aa9f60ed30a6207f5f7c0625d62f5035d"}
Oct 30 07:30:05.209051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:05.209034    5073 scope.go:122] "RemoveContainer" containerID="798b58f9173b292be95a1f083e8d192aa9f60ed30a6207f5f7c0625d62f5035d"
Oct 30 07:30:06.222553 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:06.222514    5073 generic.go:356] "Generic (PLEG): container finished" podID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerID="35c193b2542efee50ed8cdb41880c7153b87c1a0d3c471af1099c81d0a11c040" exitCode=60
Oct 30 07:30:06.223051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:06.222591    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" event={"ID":"7cf6dffb-11d2-4bd3-a518-1002cdd491fb","Type":"ContainerDied","Data":"35c193b2542efee50ed8cdb41880c7153b87c1a0d3c471af1099c81d0a11c040"}
Oct 30 07:30:06.223051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:06.222651    5073 scope.go:122] "RemoveContainer" containerID="798b58f9173b292be95a1f083e8d192aa9f60ed30a6207f5f7c0625d62f5035d"
Oct 30 07:30:06.223186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:06.223079    5073 scope.go:122] "RemoveContainer" containerID="35c193b2542efee50ed8cdb41880c7153b87c1a0d3c471af1099c81d0a11c040"
Oct 30 07:30:06.223524 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:06.223498    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg_odh-ai-gateway-infra(7cf6dffb-11d2-4bd3-a518-1002cdd491fb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb"
Oct 30 07:30:07.231777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:07.231749    5073 scope.go:122] "RemoveContainer" containerID="35c193b2542efee50ed8cdb41880c7153b87c1a0d3c471af1099c81d0a11c040"
Oct 30 07:30:07.232206 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:07.232122    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg_odh-ai-gateway-infra(7cf6dffb-11d2-4bd3-a518-1002cdd491fb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb"
Oct 30 07:30:12.094403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.094369    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"]
Oct 30 07:30:12.100651 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.100628    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.114529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.114468    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w4-a475d6-serving-cert\""
Oct 30 07:30:12.131466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.131434    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"]
Oct 30 07:30:12.137131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.137095    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5bvx\" (UniqueName: \"kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.137313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.137286    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.137383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.137344    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.137485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.137466    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.238801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.238759    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5bvx\" (UniqueName: \"kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.239027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.238883    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.239027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.238918    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.239027 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.239010    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.239197 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:12.239111    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-serving-cert: secret "maas-api-e2e-shared-a-w4-a475d6-serving-cert" not found
Oct 30 07:30:12.239197 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:12.239187    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls podName:ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36 nodeName:}" failed. No retries permitted until 2026-10-30 07:30:12.739171588 +0000 UTC m=+2015.447051739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls") pod "maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" (UID: "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36") : secret "maas-api-e2e-shared-a-w4-a475d6-serving-cert" not found
Oct 30 07:30:12.239906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.239840    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.241737 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.241715    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.268208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.262530    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5bvx\" (UniqueName: \"kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.761048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.761009    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:12.763451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:12.763420    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:13.015917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:13.015812    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:13.325572 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:30:13.325538    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4356d8_2dd5_4e7e_8e53_98a37f7e4f36.slice/crio-ce2708683c334ffd47c5c22aa3a6fc2a10c983743f2e06dbec4f7525b8fe221a WatchSource:0}: Error finding container ce2708683c334ffd47c5c22aa3a6fc2a10c983743f2e06dbec4f7525b8fe221a: Status 404 returned error can't find the container with id ce2708683c334ffd47c5c22aa3a6fc2a10c983743f2e06dbec4f7525b8fe221a
Oct 30 07:30:13.326159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:13.326135    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"]
Oct 30 07:30:13.941916 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:13.941781    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:30:14.331756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:14.331657    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" event={"ID":"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36","Type":"ContainerStarted","Data":"c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267"}
Oct 30 07:30:14.331756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:14.331718    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" event={"ID":"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36","Type":"ContainerStarted","Data":"ce2708683c334ffd47c5c22aa3a6fc2a10c983743f2e06dbec4f7525b8fe221a"}
Oct 30 07:30:14.332425 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:14.331933    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:14.373217 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:14.373152    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" podStartSLOduration=2.043755111 podStartE2EDuration="2.373132934s" totalImagesPullingTime="329.377823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:30:14.372120116 +0000 UTC m=+2017.080000286" watchObservedRunningTime="2026-10-30 07:30:14.373132934 +0000 UTC m=+2017.081013111"
Oct 30 07:30:20.344490 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:20.344412    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 07:30:20.415158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:20.415128    5073 scope.go:122] "RemoveContainer" containerID="35c193b2542efee50ed8cdb41880c7153b87c1a0d3c471af1099c81d0a11c040"
Oct 30 07:30:21.407609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:21.407569    5073 generic.go:356] "Generic (PLEG): container finished" podID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerID="15f96b90fce31bf3aa68d2b81a19f43a17c246600e04c8618bbff0f57ecee294" exitCode=60
Oct 30 07:30:21.408134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:21.407640    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" event={"ID":"7cf6dffb-11d2-4bd3-a518-1002cdd491fb","Type":"ContainerDied","Data":"15f96b90fce31bf3aa68d2b81a19f43a17c246600e04c8618bbff0f57ecee294"}
Oct 30 07:30:21.408134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:21.407727    5073 scope.go:122] "RemoveContainer" containerID="35c193b2542efee50ed8cdb41880c7153b87c1a0d3c471af1099c81d0a11c040"
Oct 30 07:30:21.408245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:21.408184    5073 scope.go:122] "RemoveContainer" containerID="15f96b90fce31bf3aa68d2b81a19f43a17c246600e04c8618bbff0f57ecee294"
Oct 30 07:30:21.408603 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:21.408582    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg_odh-ai-gateway-infra(7cf6dffb-11d2-4bd3-a518-1002cdd491fb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb"
Oct 30 07:30:22.461064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.461031    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"]
Oct 30 07:30:22.651084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.651055    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:22.767763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.767677    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca\") pod \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") "
Oct 30 07:30:22.767967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.767955    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4\" (UniqueName: \"kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4\") pod \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\" (UID: \"7cf6dffb-11d2-4bd3-a518-1002cdd491fb\") "
Oct 30 07:30:22.768049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.768015    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca" pod "7cf6dffb-11d2-4bd3-a518-1002cdd491fb" (UID: "7cf6dffb-11d2-4bd3-a518-1002cdd491fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:30:22.768317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.768299    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:30:22.770007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.769980    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4" pod "7cf6dffb-11d2-4bd3-a518-1002cdd491fb" (UID: "7cf6dffb-11d2-4bd3-a518-1002cdd491fb"). InnerVolumeSpecName "kube-api-access-zmhx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:30:22.869814 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:22.869781    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmhx4\" (UniqueName: \"kubernetes.io/projected/7cf6dffb-11d2-4bd3-a518-1002cdd491fb-kube-api-access-zmhx4\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:30:23.427017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:23.426983    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"
Oct 30 07:30:23.427204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:23.427012    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg" event={"ID":"7cf6dffb-11d2-4bd3-a518-1002cdd491fb","Type":"ContainerDied","Data":"5d65dc72da21296a9c0412088ad9e5ed717ec13d704fb86024171424aae6b383"}
Oct 30 07:30:23.427204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:23.427073    5073 scope.go:122] "RemoveContainer" containerID="15f96b90fce31bf3aa68d2b81a19f43a17c246600e04c8618bbff0f57ecee294"
Oct 30 07:30:23.483189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:23.483136    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"]
Oct 30 07:30:23.491773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:23.491743    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889090-bkgpg"]
Oct 30 07:30:25.436181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:25.436147    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" path="/var/lib/kubelet/pods/7cf6dffb-11d2-4bd3-a518-1002cdd491fb/volumes"
Oct 30 07:30:38.590157 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:38.590068    5073 generic.go:356] "Generic (PLEG): container finished" podID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerID="9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca" exitCode=0
Oct 30 07:30:38.590691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:38.590152    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" event={"ID":"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e","Type":"ContainerDied","Data":"9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"}
Oct 30 07:30:38.590766 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:38.590689    5073 scope.go:122] "RemoveContainer" containerID="9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"
Oct 30 07:30:38.592493 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:38.592464    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:30:38.592604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:38.592528    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:30:38.592604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:38.592575    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:30:39.636984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:39.636878    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" event={"ID":"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e","Type":"ContainerStarted","Data":"dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d"}
Oct 30 07:30:40.443004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:40.442965    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:30:40.443960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:40.443931    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 07:30:40.444089 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:40.443999    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 07:30:41.442319 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:41.442284    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 07:30:41.442740 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:41.442339    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 07:30:42.443036 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:42.443001    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 07:30:42.443436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:42.443053    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 07:30:43.455181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:43.455143    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 07:30:43.455943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:43.455907    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 07:30:43.926743 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:30:43.926500    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:30:43.996986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:43.995938    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:30:44.442827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:44.442793    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused" start-of-body=
Oct 30 07:30:44.443038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:44.442847    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.152:15021/healthz/ready\": dial tcp 10.132.0.152:15021: connect: connection refused"
Oct 30 07:30:45.449680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:45.449650    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:30:45.450881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:45.450826    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 07:30:48.128692 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.128655    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"]
Oct 30 07:30:48.129782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.129746    5073 cpu_manager.go:414] "containerMap: removing container" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.129782 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.129770    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.130068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.129865    5073 cpu_manager.go:414] "containerMap: removing container" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.130068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.129876    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.130221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.130066    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.130221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.130083    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.130221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.130104    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:30:48.134201 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.134182    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.168038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.168001    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"]
Oct 30 07:30:48.201686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.201656    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w4-d09eb6-openshift-default-dockercfg-v84j4\""
Oct 30 07:30:48.226452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.226419    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.226722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.226697    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwm4x\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.226998 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.226978    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.227216 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.227197    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.227687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.227663    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.227954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.227934    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.228184 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.228156    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.228295 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.228220    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.228651 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.228629    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393060    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwm4x\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393133    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393200    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393320    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393417    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393495    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393564    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393715    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.393761    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.403937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.396161    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.420876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.405124    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.420876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.410790    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.420876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.411128    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.420876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.411793    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.468348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.467205    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.468348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.468272    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.500873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.486977    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwm4x\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.500873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.487390    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo\") pod \"e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") " pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:48.755240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:48.755138    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:49.082296 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:30:49.082262    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f91f18b_c52a_49be_ae98_41f3a4d3d401.slice/crio-a3f7dfed81b1cf0c311e61ad1fb1c038f34922a85bd7f0487bb9e59543e321b5 WatchSource:0}: Error finding container a3f7dfed81b1cf0c311e61ad1fb1c038f34922a85bd7f0487bb9e59543e321b5: Status 404 returned error can't find the container with id a3f7dfed81b1cf0c311e61ad1fb1c038f34922a85bd7f0487bb9e59543e321b5
Oct 30 07:30:49.082881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.082831    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"]
Oct 30 07:30:49.084995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.084960    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:30:49.085146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.085039    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:30:49.085146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.085087    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:30:49.751694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.751653    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" event={"ID":"9f91f18b-c52a-49be-ae98-41f3a4d3d401","Type":"ContainerStarted","Data":"6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"}
Oct 30 07:30:49.752113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.751720    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" event={"ID":"9f91f18b-c52a-49be-ae98-41f3a4d3d401","Type":"ContainerStarted","Data":"a3f7dfed81b1cf0c311e61ad1fb1c038f34922a85bd7f0487bb9e59543e321b5"}
Oct 30 07:30:49.758086 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.758062    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:49.807302 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:49.807247    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podStartSLOduration=1.807219897 podStartE2EDuration="1.807219897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:30:49.80616648 +0000 UTC m=+2052.514046649" watchObservedRunningTime="2026-10-30 07:30:49.807219897 +0000 UTC m=+2052.515100067"
Oct 30 07:30:50.763754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:50.763725    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:51.767232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:51.767201    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:30:51.768237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:30:51.768217    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:31:13.925256 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:31:13.925220    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:31:32.021760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:32.021726    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"]
Oct 30 07:31:32.022259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:32.021942    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy" containerID="cri-o://e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde" gracePeriod=30
Oct 30 07:31:37.341443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.341407    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:31:37.501475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501443    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.501668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501490    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.501668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501582    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.501668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501657    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.501838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501711    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.501838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501710    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:31:37.501838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501754    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.501838 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501804    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.502070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501870    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:31:37.502070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501984    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.502070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.501995    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:31:37.502070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502046    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket\") pod \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\" (UID: \"25318518-e554-4f0e-89e2-3ce2eb1d8db4\") "
Oct 30 07:31:37.502454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502387    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:31:37.502454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502392    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:31:37.503024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502937    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.503024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502964    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.503024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502977    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.503024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.502991    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.503024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.503005    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.504313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.504286    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:31:37.504574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.504549    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "kube-api-access-jd7c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:31:37.504744 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.504585    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:31:37.505100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.505080    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo" pod "25318518-e554-4f0e-89e2-3ce2eb1d8db4" (UID: "25318518-e554-4f0e-89e2-3ce2eb1d8db4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:31:37.605155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.605034    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.605155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.605061    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.605155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.605070    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd7c9\" (UniqueName: \"kubernetes.io/projected/25318518-e554-4f0e-89e2-3ce2eb1d8db4-kube-api-access-jd7c9\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.605155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.605081    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25318518-e554-4f0e-89e2-3ce2eb1d8db4-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:31:37.975328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.975302    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:31:37.995299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:37.995268    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:31:38.139756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.139724    5073 generic.go:356] "Generic (PLEG): container finished" podID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerID="e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde" exitCode=0
Oct 30 07:31:38.139948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.139767    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"
Oct 30 07:31:38.139948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.139805    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" event={"ID":"25318518-e554-4f0e-89e2-3ce2eb1d8db4","Type":"ContainerDied","Data":"e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde"}
Oct 30 07:31:38.139948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.139872    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927" event={"ID":"25318518-e554-4f0e-89e2-3ce2eb1d8db4","Type":"ContainerDied","Data":"f7f2c9b655e4697fecf10e5bed83616f3d3a74062fbe28c20de0108d562e6bd8"}
Oct 30 07:31:38.139948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.139900    5073 scope.go:122] "RemoveContainer" containerID="e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde"
Oct 30 07:31:38.151266 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.151065    5073 scope.go:122] "RemoveContainer" containerID="e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde"
Oct 30 07:31:38.151351 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:31:38.151330    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde\": container with ID starting with e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde not found: ID does not exist" containerID="e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde"
Oct 30 07:31:38.151418 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.151354    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde"} err="failed to get container status \"e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde\": rpc error: code = NotFound desc = could not find container \"e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde\": container with ID starting with e3b3b3439d8422626bfbb777b53f057a8fb6b103f28a369591e457720dcedcde not found: ID does not exist"
Oct 30 07:31:38.202479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.202446    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"]
Oct 30 07:31:38.213824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:38.213793    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-rd927"]
Oct 30 07:31:39.425793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:31:39.425759    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" path="/var/lib/kubelet/pods/25318518-e554-4f0e-89e2-3ce2eb1d8db4/volumes"
Oct 30 07:31:43.925079 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:31:43.925045    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:32:02.511506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:02.511398    5073 generic.go:356] "Generic (PLEG): container finished" podID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerID="6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1" exitCode=0
Oct 30 07:32:02.511506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:02.511488    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" event={"ID":"9f91f18b-c52a-49be-ae98-41f3a4d3d401","Type":"ContainerDied","Data":"6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"}
Oct 30 07:32:02.512145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:02.512109    5073 scope.go:122] "RemoveContainer" containerID="6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"
Oct 30 07:32:02.514393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:02.514364    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:32:02.514526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:02.514449    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:32:02.514526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:02.514499    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:32:03.659745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:03.659705    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" event={"ID":"9f91f18b-c52a-49be-ae98-41f3a4d3d401","Type":"ContainerStarted","Data":"0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57"}
Oct 30 07:32:03.757595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:03.757565    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:32:03.758260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:03.758228    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 07:32:03.758364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:03.758276    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 07:32:04.757944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:04.757904    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 07:32:04.758345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:04.757983    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 07:32:05.757886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:05.757833    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 07:32:05.758082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:05.757913    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 07:32:06.758142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:06.758109    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 07:32:06.758523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:06.758164    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 07:32:06.767349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:06.767324    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:32:07.757788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:07.757749    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 07:32:07.758026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:07.757813    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 07:32:08.757815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:08.757780    5073 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused" start-of-body=
Oct 30 07:32:08.758226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:08.757836    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.156:15021/healthz/ready\": dial tcp 10.132.0.156:15021: connect: connection refused"
Oct 30 07:32:09.764200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:09.764163    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:32:09.765378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:09.765353    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 07:32:13.994643 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:32:13.994588    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:32:36.320244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:36.320201    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"]
Oct 30 07:32:43.363830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:43.363793    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"]
Oct 30 07:32:43.364277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:43.364041    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy" containerID="cri-o://6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4" gracePeriod=30
Oct 30 07:32:44.212123 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:32:44.212078    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:32:47.872978 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:47.872943    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"]
Oct 30 07:32:47.873591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:47.873136    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy" containerID="cri-o://61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe" gracePeriod=30
Oct 30 07:32:48.080756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.080716    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"]
Oct 30 07:32:48.081080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.081049    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy" containerID="cri-o://a0312ba1a79e812a4071113ce130baa4bf8cb964d45eab9e2ad0c8939905737d" gracePeriod=30
Oct 30 07:32:48.706973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.706942    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:32:48.763383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763348    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.763571 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763450    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.763571 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763483    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.763707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763618    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.763707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763662    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.763818 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763742    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.763967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763945    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.764045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.763999    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.764105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.764082    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert\") pod \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\" (UID: \"a43d1aea-dc5d-4356-8a07-00d4851d01f0\") "
Oct 30 07:32:48.764376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.764285    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:48.764526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.764501    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:48.764655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.764519    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:48.764655 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.764466    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:48.765022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.764982    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:32:48.765407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.765387    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.765492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.765411    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.765492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.765425    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.765492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.765438    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.765492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.765452    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.767389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.767361    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:48.767488 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.767363    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:48.767712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.767680    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "kube-api-access-nkhfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:48.768958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.768933    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo" pod "a43d1aea-dc5d-4356-8a07-00d4851d01f0" (UID: "a43d1aea-dc5d-4356-8a07-00d4851d01f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:32:48.868686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.868579    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.868686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.868617    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkhfx\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-kube-api-access-nkhfx\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.868686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.868632    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:48.868686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:48.868645    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a43d1aea-dc5d-4356-8a07-00d4851d01f0-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:49.320940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.320898    5073 generic.go:356] "Generic (PLEG): container finished" podID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerID="6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4" exitCode=0
Oct 30 07:32:49.320940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.320948    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"
Oct 30 07:32:49.321387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.320984    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" event={"ID":"a43d1aea-dc5d-4356-8a07-00d4851d01f0","Type":"ContainerDied","Data":"6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4"}
Oct 30 07:32:49.321387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.321046    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk" event={"ID":"a43d1aea-dc5d-4356-8a07-00d4851d01f0","Type":"ContainerDied","Data":"bb587fc0c03e91c775f670e8ec5cdc8085f764af472c7bd20a8d8215f1a7434d"}
Oct 30 07:32:49.321387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.321071    5073 scope.go:122] "RemoveContainer" containerID="6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4"
Oct 30 07:32:49.332770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.332753    5073 scope.go:122] "RemoveContainer" containerID="6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4"
Oct 30 07:32:49.333052 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:32:49.333033    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4\": container with ID starting with 6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4 not found: ID does not exist" containerID="6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4"
Oct 30 07:32:49.333100 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.333061    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4"} err="failed to get container status \"6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4\": rpc error: code = NotFound desc = could not find container \"6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4\": container with ID starting with 6daea5f5742493aac495231cd09af2e1be98ef6ef77cd3d9642d7084f9ed35d4 not found: ID does not exist"
Oct 30 07:32:49.373005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.372979    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"]
Oct 30 07:32:49.384534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.384509    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-ztkkk"]
Oct 30 07:32:49.424501 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:49.424472    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" path="/var/lib/kubelet/pods/a43d1aea-dc5d-4356-8a07-00d4851d01f0/volumes"
Oct 30 07:32:51.355767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.355707    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" podUID="af774e9a-0480-4526-8065-cb33abc8cfe6" containerName="main" containerID="cri-o://cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76" gracePeriod=45
Oct 30 07:32:51.369413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.369380    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" podUID="af774e9a-0480-4526-8065-cb33abc8cfe6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.149:8000/ready\": dial tcp 10.132.0.149:8000: connect: connection refused"
Oct 30 07:32:51.674405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.674381    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:32:51.711255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711225    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir\") pod \"af774e9a-0480-4526-8065-cb33abc8cfe6\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") "
Oct 30 07:32:51.711402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711272    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home\") pod \"af774e9a-0480-4526-8065-cb33abc8cfe6\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") "
Oct 30 07:32:51.711464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711415    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache\") pod \"af774e9a-0480-4526-8065-cb33abc8cfe6\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") "
Oct 30 07:32:51.711592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711553    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir" pod "af774e9a-0480-4526-8065-cb33abc8cfe6" (UID: "af774e9a-0480-4526-8065-cb33abc8cfe6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:51.711592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711568    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs\" (UniqueName: \"kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs\") pod \"af774e9a-0480-4526-8065-cb33abc8cfe6\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") "
Oct 30 07:32:51.711592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711572    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home" pod "af774e9a-0480-4526-8065-cb33abc8cfe6" (UID: "af774e9a-0480-4526-8065-cb33abc8cfe6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:51.711831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711604    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg\" (UniqueName: \"kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg\") pod \"af774e9a-0480-4526-8065-cb33abc8cfe6\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") "
Oct 30 07:32:51.711831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711694    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm\") pod \"af774e9a-0480-4526-8065-cb33abc8cfe6\" (UID: \"af774e9a-0480-4526-8065-cb33abc8cfe6\") "
Oct 30 07:32:51.711831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.711692    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache" pod "af774e9a-0480-4526-8065-cb33abc8cfe6" (UID: "af774e9a-0480-4526-8065-cb33abc8cfe6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:51.712404 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.712383    5073 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-tmp-dir\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:51.712495 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.712407    5073 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-home\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:51.712495 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.712421    5073 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-model-cache\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:51.714726 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.714702    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm" pod "af774e9a-0480-4526-8065-cb33abc8cfe6" (UID: "af774e9a-0480-4526-8065-cb33abc8cfe6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:51.715267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.715241    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs" pod "af774e9a-0480-4526-8065-cb33abc8cfe6" (UID: "af774e9a-0480-4526-8065-cb33abc8cfe6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:32:51.717199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.715610    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg" pod "af774e9a-0480-4526-8065-cb33abc8cfe6" (UID: "af774e9a-0480-4526-8065-cb33abc8cfe6"). InnerVolumeSpecName "kube-api-access-7hztg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:51.813619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.813584    5073 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af774e9a-0480-4526-8065-cb33abc8cfe6-tls-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:51.813619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.813616    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hztg\" (UniqueName: \"kubernetes.io/projected/af774e9a-0480-4526-8065-cb33abc8cfe6-kube-api-access-7hztg\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:51.813619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:51.813625    5073 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af774e9a-0480-4526-8065-cb33abc8cfe6-dshm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:52.345609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.345574    5073 generic.go:356] "Generic (PLEG): container finished" podID="af774e9a-0480-4526-8065-cb33abc8cfe6" containerID="cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76" exitCode=0
Oct 30 07:32:52.345825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.345624    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"
Oct 30 07:32:52.345825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.345655    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" event={"ID":"af774e9a-0480-4526-8065-cb33abc8cfe6","Type":"ContainerDied","Data":"cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76"}
Oct 30 07:32:52.345825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.345697    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7" event={"ID":"af774e9a-0480-4526-8065-cb33abc8cfe6","Type":"ContainerDied","Data":"0af1be8f4737d55181281b36b3f4e8265aec2a8735e3ad82519b28f973727ac3"}
Oct 30 07:32:52.345825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.345714    5073 scope.go:122] "RemoveContainer" containerID="cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76"
Oct 30 07:32:52.358620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.358412    5073 scope.go:122] "RemoveContainer" containerID="cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76"
Oct 30 07:32:52.358891 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:32:52.358666    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76\": container with ID starting with cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76 not found: ID does not exist" containerID="cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76"
Oct 30 07:32:52.358891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.358690    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76"} err="failed to get container status \"cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76\": rpc error: code = NotFound desc = could not find container \"cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76\": container with ID starting with cd86a1b37f0a4a969f253c0557488c3cc0a23d65bb124bdec68456222ac4fb76 not found: ID does not exist"
Oct 30 07:32:52.397701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.397670    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"]
Oct 30 07:32:52.407351 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:52.407327    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-137122/auth-test-model-137122-kserve-6b7f6ddcbf-nwpc7"]
Oct 30 07:32:53.223328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.222564    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:32:53.341249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341217    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.341453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341269    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.341453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341306    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.341453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341359    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.341453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341387    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.341453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341436    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.341738 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341542    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.341738 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341610    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.341738 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341697    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.342053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341772    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.342053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341826    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj\") pod \"fd6414a4-9682-4d4f-b315-839634fc241b\" (UID: \"fd6414a4-9682-4d4f-b315-839634fc241b\") "
Oct 30 07:32:53.342053 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.341900    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.342238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342106    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.342238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342138    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:32:53.342514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342482    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.342679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342662    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.342787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342682    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd6414a4-9682-4d4f-b315-839634fc241b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.342787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342700    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.342787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.342723    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.344582 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.344555    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:32:53.344975 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.344952    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:53.345086 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.344991    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "kube-api-access-qfdbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:53.345739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.345703    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy" pod "fd6414a4-9682-4d4f-b315-839634fc241b" (UID: "fd6414a4-9682-4d4f-b315-839634fc241b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.355662 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.355635    5073 generic.go:356] "Generic (PLEG): container finished" podID="fd6414a4-9682-4d4f-b315-839634fc241b" containerID="61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe" exitCode=0
Oct 30 07:32:53.355763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.355677    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" event={"ID":"fd6414a4-9682-4d4f-b315-839634fc241b","Type":"ContainerDied","Data":"61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe"}
Oct 30 07:32:53.355763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.355745    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98" event={"ID":"fd6414a4-9682-4d4f-b315-839634fc241b","Type":"ContainerDied","Data":"c3c75b256d328900c9f1374b142f2092c64a66d256b45b1e1cbb88a8817b3785"}
Oct 30 07:32:53.355763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.355687    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"
Oct 30 07:32:53.355939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.355777    5073 scope.go:122] "RemoveContainer" containerID="61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe"
Oct 30 07:32:53.358649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.358626    5073 generic.go:356] "Generic (PLEG): container finished" podID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerID="a0312ba1a79e812a4071113ce130baa4bf8cb964d45eab9e2ad0c8939905737d" exitCode=0
Oct 30 07:32:53.358967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.358682    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" event={"ID":"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c","Type":"ContainerDied","Data":"a0312ba1a79e812a4071113ce130baa4bf8cb964d45eab9e2ad0c8939905737d"}
Oct 30 07:32:53.362186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.362168    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:32:53.367536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.367371    5073 scope.go:122] "RemoveContainer" containerID="61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe"
Oct 30 07:32:53.367684 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:32:53.367635    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe\": container with ID starting with 61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe not found: ID does not exist" containerID="61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe"
Oct 30 07:32:53.367684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.367666    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe"} err="failed to get container status \"61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe\": rpc error: code = NotFound desc = could not find container \"61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe\": container with ID starting with 61cbd3bcb18166c18c5d7acbd6fee8f9823a03b9db9973ddc2821146d32a4ffe not found: ID does not exist"
Oct 30 07:32:53.443472 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443381    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443492    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443529    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443588    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443697    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443722    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443772    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.443876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443833    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.444110 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.443887    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs\") pod \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\" (UID: \"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c\") "
Oct 30 07:32:53.444960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.444361    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:32:53.444960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.444635    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af774e9a-0480-4526-8065-cb33abc8cfe6" path="/var/lib/kubelet/pods/af774e9a-0480-4526-8065-cb33abc8cfe6/volumes"
Oct 30 07:32:53.444960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.444645    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.444960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.444823    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.445253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.445080    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.445995 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.445965    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.445999    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd6414a4-9682-4d4f-b315-839634fc241b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.446015    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd6414a4-9682-4d4f-b315-839634fc241b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.446028    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfdbj\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-kube-api-access-qfdbj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.446044    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.446058    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd6414a4-9682-4d4f-b315-839634fc241b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.446070    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.446103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.446082    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.448427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.448398    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.449317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.449295    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:53.449441 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.449295    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:53.449714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.449693    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:32:53.450192 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.450168    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs" pod "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" (UID: "fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c"). InnerVolumeSpecName "kube-api-access-2gcfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:53.455790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.455766    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"]
Oct 30 07:32:53.466113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.466088    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-zmp98"]
Oct 30 07:32:53.548000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.547957    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.548000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.547988    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.548000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.548001    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.548241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.548011    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.548241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.548023    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gcfs\" (UniqueName: \"kubernetes.io/projected/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c-kube-api-access-2gcfs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:53.875451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.875417    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"]
Oct 30 07:32:53.875739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.875709    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy" containerID="cri-o://3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034" gracePeriod=30
Oct 30 07:32:53.881626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.881596    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"]
Oct 30 07:32:53.881884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:53.881824    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy" containerID="cri-o://0c79f8e84d3cea5a1fa7b8ca8cd02e9cc818bbf5cb6b40c4fc8a1fdb0970e20d" gracePeriod=30
Oct 30 07:32:54.368380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:54.368283    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz" event={"ID":"fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c","Type":"ContainerDied","Data":"650feebb005d8479c9d6cf05f95e4cc3cc9033587aaa48fc387f2e8da2c04b45"}
Oct 30 07:32:54.368380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:54.368292    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"
Oct 30 07:32:54.368380 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:54.368370    5073 scope.go:122] "RemoveContainer" containerID="a0312ba1a79e812a4071113ce130baa4bf8cb964d45eab9e2ad0c8939905737d"
Oct 30 07:32:54.448900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:54.447128    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"]
Oct 30 07:32:54.493045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:54.483679    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-d9zdz"]
Oct 30 07:32:55.488892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:55.485738    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" path="/var/lib/kubelet/pods/fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c/volumes"
Oct 30 07:32:55.488892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:55.487510    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" path="/var/lib/kubelet/pods/fd6414a4-9682-4d4f-b315-839634fc241b/volumes"
Oct 30 07:32:59.170276 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.170222    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:32:59.254638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.254591    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.254827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.254666    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.254827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.254758    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.254827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.254804    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.255019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.254847    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.255019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.254946    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.255125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.255060    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.255175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.255127    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.255246 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.255226    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket\") pod \"16fb31f7-eabc-4b7c-9361-91708b6ff638\" (UID: \"16fb31f7-eabc-4b7c-9361-91708b6ff638\") "
Oct 30 07:32:59.256115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.255882    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:32:59.256115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.256086    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.256298 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.256244    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.256494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.256459    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.256646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.256617    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.258297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.258248    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.258711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.258680    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "kube-api-access-d26t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:59.259077 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.259051    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:32:59.259183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.259095    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token" pod "16fb31f7-eabc-4b7c-9361-91708b6ff638" (UID: "16fb31f7-eabc-4b7c-9361-91708b6ff638"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:59.357424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357392    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357422    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357431    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357439    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d26t9\" (UniqueName: \"kubernetes.io/projected/16fb31f7-eabc-4b7c-9361-91708b6ff638-kube-api-access-d26t9\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357448    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb31f7-eabc-4b7c-9361-91708b6ff638-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357456    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357465    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357474    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.357668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.357482    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb31f7-eabc-4b7c-9361-91708b6ff638-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.443428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.443394    5073 generic.go:356] "Generic (PLEG): container finished" podID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerID="0c79f8e84d3cea5a1fa7b8ca8cd02e9cc818bbf5cb6b40c4fc8a1fdb0970e20d" exitCode=0
Oct 30 07:32:59.443603 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.443473    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" event={"ID":"79fa46b7-c2a7-40e8-bdc3-306128f00246","Type":"ContainerDied","Data":"0c79f8e84d3cea5a1fa7b8ca8cd02e9cc818bbf5cb6b40c4fc8a1fdb0970e20d"}
Oct 30 07:32:59.445131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.445096    5073 generic.go:356] "Generic (PLEG): container finished" podID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerID="3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034" exitCode=0
Oct 30 07:32:59.445255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.445155    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"
Oct 30 07:32:59.445255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.445168    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" event={"ID":"16fb31f7-eabc-4b7c-9361-91708b6ff638","Type":"ContainerDied","Data":"3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034"}
Oct 30 07:32:59.445255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.445208    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx" event={"ID":"16fb31f7-eabc-4b7c-9361-91708b6ff638","Type":"ContainerDied","Data":"375087944e8aa1498d06361aad5144daa67b86f0458a03bc5869d592eb9a28da"}
Oct 30 07:32:59.445255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.445229    5073 scope.go:122] "RemoveContainer" containerID="3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034"
Oct 30 07:32:59.456188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.456162    5073 scope.go:122] "RemoveContainer" containerID="3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034"
Oct 30 07:32:59.456547 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:32:59.456525    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034\": container with ID starting with 3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034 not found: ID does not exist" containerID="3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034"
Oct 30 07:32:59.456633 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.456558    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034"} err="failed to get container status \"3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034\": rpc error: code = NotFound desc = could not find container \"3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034\": container with ID starting with 3135869ff5f6477802da6215ce6a80bb7c2477a04fa26b5423a1b5d167622034 not found: ID does not exist"
Oct 30 07:32:59.514874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.511917    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"]
Oct 30 07:32:59.517148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.517122    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-tmqbx"]
Oct 30 07:32:59.560140 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.560116    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:32:59.661261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661217    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661281    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661311    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661329    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661485    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661501    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.661640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661578    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661641    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661652    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.661697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661669    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661789    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert\") pod \"79fa46b7-c2a7-40e8-bdc3-306128f00246\" (UID: \"79fa46b7-c2a7-40e8-bdc3-306128f00246\") "
Oct 30 07:32:59.661939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661909    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.661992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.661951    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.662301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.662278    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:32:59.662479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.662461    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.662552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.662485    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.662552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.662499    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.662552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.662513    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.662552 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.662527    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79fa46b7-c2a7-40e8-bdc3-306128f00246-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.664089 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.664064    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:32:59.664345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.664095    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:59.664345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.664143    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "kube-api-access-bnt7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:32:59.664345 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.664146    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo" pod "79fa46b7-c2a7-40e8-bdc3-306128f00246" (UID: "79fa46b7-c2a7-40e8-bdc3-306128f00246"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:32:59.763829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.763750    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.763829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.763780    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.763829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.763790    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnt7d\" (UniqueName: \"kubernetes.io/projected/79fa46b7-c2a7-40e8-bdc3-306128f00246-kube-api-access-bnt7d\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:32:59.763829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:32:59.763800    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79fa46b7-c2a7-40e8-bdc3-306128f00246-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:00.454639 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:00.454610    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"
Oct 30 07:33:00.455144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:00.454640    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw" event={"ID":"79fa46b7-c2a7-40e8-bdc3-306128f00246","Type":"ContainerDied","Data":"9ab1e5078e6bc9f5012e6304665b2c3de2ba52281c64441211e224d208cc6d3e"}
Oct 30 07:33:00.455144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:00.454702    5073 scope.go:122] "RemoveContainer" containerID="0c79f8e84d3cea5a1fa7b8ca8cd02e9cc818bbf5cb6b40c4fc8a1fdb0970e20d"
Oct 30 07:33:00.509318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:00.509286    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"]
Oct 30 07:33:00.520511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:00.520484    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-qmlnw"]
Oct 30 07:33:01.426412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:01.426368    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" path="/var/lib/kubelet/pods/16fb31f7-eabc-4b7c-9361-91708b6ff638/volumes"
Oct 30 07:33:01.427016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:01.426994    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" path="/var/lib/kubelet/pods/79fa46b7-c2a7-40e8-bdc3-306128f00246/volumes"
Oct 30 07:33:03.129426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:03.129389    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"]
Oct 30 07:33:03.129863 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:03.129626    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy" containerID="cri-o://bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304" gracePeriod=30
Oct 30 07:33:08.421262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.421233    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:33:08.514327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514291    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514368    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514406    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514502    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514549    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514648    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514675    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514703    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.514724 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514702    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:33:08.515049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.514832    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data\") pod \"88272e24-340e-4863-aa87-989989c99ea4\" (UID: \"88272e24-340e-4863-aa87-989989c99ea4\") "
Oct 30 07:33:08.515197 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.515162    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:33:08.515387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.515329    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:33:08.515507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.515486    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:33:08.515682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.515656    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:33:08.516184 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.516161    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.516375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.516188    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.516375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.516203    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.516375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.516217    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88272e24-340e-4863-aa87-989989c99ea4-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.516375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.516229    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.519890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.517914    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:33:08.519890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.518067    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "kube-api-access-vq755". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:33:08.519890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.518105    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:33:08.519890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.519725    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo" pod "88272e24-340e-4863-aa87-989989c99ea4" (UID: "88272e24-340e-4863-aa87-989989c99ea4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:33:08.543042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.543009    5073 generic.go:356] "Generic (PLEG): container finished" podID="88272e24-340e-4863-aa87-989989c99ea4" containerID="bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304" exitCode=0
Oct 30 07:33:08.543132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.543060    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"
Oct 30 07:33:08.543132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.543093    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" event={"ID":"88272e24-340e-4863-aa87-989989c99ea4","Type":"ContainerDied","Data":"bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304"}
Oct 30 07:33:08.543229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.543159    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7" event={"ID":"88272e24-340e-4863-aa87-989989c99ea4","Type":"ContainerDied","Data":"a953c6f961d1d2c5d2058f02183c311a8ed7d5ddac7e2e41d0d15e2b839388b3"}
Oct 30 07:33:08.543229 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.543189    5073 scope.go:122] "RemoveContainer" containerID="bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304"
Oct 30 07:33:08.555763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.555741    5073 scope.go:122] "RemoveContainer" containerID="bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304"
Oct 30 07:33:08.556077 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:33:08.556053    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304\": container with ID starting with bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304 not found: ID does not exist" containerID="bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304"
Oct 30 07:33:08.556149 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.556085    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304"} err="failed to get container status \"bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304\": rpc error: code = NotFound desc = could not find container \"bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304\": container with ID starting with bb45edcb163cf46338f40277083989686d256a47b4242acfcc4f7dc501a04304 not found: ID does not exist"
Oct 30 07:33:08.594349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.594161    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"]
Oct 30 07:33:08.608498 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.608427    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-rc6j7"]
Oct 30 07:33:08.617675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.617648    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq755\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-kube-api-access-vq755\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.617675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.617674    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88272e24-340e-4863-aa87-989989c99ea4-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.617842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.617685    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88272e24-340e-4863-aa87-989989c99ea4-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:08.617842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:08.617693    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88272e24-340e-4863-aa87-989989c99ea4-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:33:09.423613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:09.423581    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88272e24-340e-4863-aa87-989989c99ea4" path="/var/lib/kubelet/pods/88272e24-340e-4863-aa87-989989c99ea4/volumes"
Oct 30 07:33:13.843526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.843480    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"]
Oct 30 07:33:13.844589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844558    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy"
Oct 30 07:33:13.844589 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844586    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844609    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844617    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844651    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844658    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844680    5073 cpu_manager.go:414] "containerMap: removing container" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844687    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844702    5073 cpu_manager.go:414] "containerMap: removing container" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844709    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844724    5073 cpu_manager.go:414] "containerMap: removing container" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844731    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844749    5073 cpu_manager.go:414] "containerMap: removing container" podUID="af774e9a-0480-4526-8065-cb33abc8cfe6" containerName="main"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844756    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af774e9a-0480-4526-8065-cb33abc8cfe6" containerName="main"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844780    5073 cpu_manager.go:414] "containerMap: removing container" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844786    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy"
Oct 30 07:33:13.844791 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844796    5073 cpu_manager.go:414] "containerMap: removing container" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.844803    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cf6dffb-11d2-4bd3-a518-1002cdd491fb" containerName="cleanup"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845003    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="79fa46b7-c2a7-40e8-bdc3-306128f00246" containerName="istio-proxy"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845022    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="25318518-e554-4f0e-89e2-3ce2eb1d8db4" containerName="istio-proxy"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845033    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="af774e9a-0480-4526-8065-cb33abc8cfe6" containerName="main"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845046    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="16fb31f7-eabc-4b7c-9361-91708b6ff638" containerName="istio-proxy"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845063    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd6414a4-9682-4d4f-b315-839634fc241b" containerName="istio-proxy"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845075    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9a37f1-ca34-4fbf-9c6d-33ff4a09a97c" containerName="istio-proxy"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845089    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a43d1aea-dc5d-4356-8a07-00d4851d01f0" containerName="istio-proxy"
Oct 30 07:33:13.845607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.845100    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="88272e24-340e-4863-aa87-989989c99ea4" containerName="istio-proxy"
Oct 30 07:33:13.851718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.851695    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:13.882054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.881164    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-ace8fb-openshift-default-dockercfg-j7xhm\""
Oct 30 07:33:13.886409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:13.886383    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"]
Oct 30 07:33:13.980709 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:33:13.980627    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.054777    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.054838    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.054963    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4b87\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.055013    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.055065    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.055100    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.055176    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.055310    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.058541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.055376    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.157868    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.157965    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158095    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158206    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158257    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158307    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158418    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4b87\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158481    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.158540    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.159899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.159813    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.160685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.160212    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.179887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.179628    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.179887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.179846    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.180153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.180065    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.190247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.190157    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.195911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.194280    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.208526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.208490    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.223179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.223142    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4b87\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87\") pod \"e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") " pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.472039 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.471963    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:14.793836 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.793716    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"]
Oct 30 07:33:14.799496 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:33:14.799467    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcd81d7_90ea_4b8b_a74a_1e8ad3ed862d.slice/crio-8b30fe37da8360fa6b9f19ef465548bb688c0fca1d4f2f0791fb635a6a2b4fa2 WatchSource:0}: Error finding container 8b30fe37da8360fa6b9f19ef465548bb688c0fca1d4f2f0791fb635a6a2b4fa2: Status 404 returned error can't find the container with id 8b30fe37da8360fa6b9f19ef465548bb688c0fca1d4f2f0791fb635a6a2b4fa2
Oct 30 07:33:14.802537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.802498    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:33:14.802620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.802571    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:33:14.802620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:14.802599    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:33:15.600333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:15.600296    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" event={"ID":"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d","Type":"ContainerStarted","Data":"52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"}
Oct 30 07:33:15.600763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:15.600375    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" event={"ID":"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d","Type":"ContainerStarted","Data":"8b30fe37da8360fa6b9f19ef465548bb688c0fca1d4f2f0791fb635a6a2b4fa2"}
Oct 30 07:33:15.663294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:15.663243    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podStartSLOduration=2.663229845 podStartE2EDuration="2.663229845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:33:15.659528229 +0000 UTC m=+2198.367408410" watchObservedRunningTime="2026-10-30 07:33:15.663229845 +0000 UTC m=+2198.371110013"
Oct 30 07:33:16.472939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:16.472892    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:16.479468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:16.479432    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:16.607642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:16.607612    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:16.608703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:16.608683    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:33:21.650732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.650657    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"]
Oct 30 07:33:21.655463 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.655443    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.672346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.672320    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-9bec5c-serving-cert\""
Oct 30 07:33:21.677077 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.677052    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"]
Oct 30 07:33:21.778768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.778729    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7z2\" (UniqueName: \"kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.778963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.778867    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.779086 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.779061    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.779179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.779103    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.880435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.880394    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.880622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.880445    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.880622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.880589    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7z2\" (UniqueName: \"kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.880755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.880662    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.881183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.881144    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.883259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.883233    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.883355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.883282    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.902988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.902926    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7z2\" (UniqueName: \"kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2\") pod \"maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:21.980882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:21.973933    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:22.362080 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:33:22.362045    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489af737_000c_44b6_8555_7337428ebe7b.slice/crio-d3bab82eee915d52b29f34651ea9bd2b4bd9d81d769ec12d5692a132660d8913 WatchSource:0}: Error finding container d3bab82eee915d52b29f34651ea9bd2b4bd9d81d769ec12d5692a132660d8913: Status 404 returned error can't find the container with id d3bab82eee915d52b29f34651ea9bd2b4bd9d81d769ec12d5692a132660d8913
Oct 30 07:33:22.362080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:22.362050    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"]
Oct 30 07:33:22.363564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:22.363544    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:33:22.651607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:22.651565    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r" event={"ID":"489af737-000c-44b6-8555-7337428ebe7b","Type":"ContainerStarted","Data":"d3bab82eee915d52b29f34651ea9bd2b4bd9d81d769ec12d5692a132660d8913"}
Oct 30 07:33:23.660235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:23.660190    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r" event={"ID":"489af737-000c-44b6-8555-7337428ebe7b","Type":"ContainerStarted","Data":"ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91"}
Oct 30 07:33:23.660648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:23.660259    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:23.703960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:23.703915    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r" podStartSLOduration=2.357414486 podStartE2EDuration="2.703902231s" totalImagesPullingTime="346.487745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:33:23.701530236 +0000 UTC m=+2206.409410406" watchObservedRunningTime="2026-10-30 07:33:23.703902231 +0000 UTC m=+2206.411782399"
Oct 30 07:33:29.674574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:29.674531    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 07:33:43.923245 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:33:43.923205    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:33:58.685669 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.685631    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"]
Oct 30 07:33:58.690410 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.690392    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.722929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.722884    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-ace8fb-serving-cert\""
Oct 30 07:33:58.728098 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.728070    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"]
Oct 30 07:33:58.740392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.740349    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmcht\" (UniqueName: \"kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.740550 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.740509    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.740683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.740656    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.740765 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.740697    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.842010 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.841969    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.842190 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:33:58.842009    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-serving-cert: secret "maas-api-e2e-extmod-b-ace8fb-serving-cert" not found
Oct 30 07:33:58.842190 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:33:58.842075    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls podName:a9f962fc-0cec-4652-b269-db7a6b81d5e6 nodeName:}" failed. No retries permitted until 2026-10-30 07:33:59.3420547 +0000 UTC m=+2242.049934861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls") pod "maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" (UID: "a9f962fc-0cec-4652-b269-db7a6b81d5e6") : secret "maas-api-e2e-extmod-b-ace8fb-serving-cert" not found
Oct 30 07:33:58.842190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.842019    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.842190 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.842182    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmcht\" (UniqueName: \"kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.842407 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.842301    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.842693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.842676    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.844916 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.844887    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:58.865712 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:58.865691    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmcht\" (UniqueName: \"kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:59.353117 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:59.353069    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:59.355515 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:59.355490    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:59.605500 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:59.605406    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:33:59.940830 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:33:59.940780    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f962fc_0cec_4652_b269_db7a6b81d5e6.slice/crio-24270351f90b4622621038da3d577abb7561ebd17d701c5150c75e2266236040 WatchSource:0}: Error finding container 24270351f90b4622621038da3d577abb7561ebd17d701c5150c75e2266236040: Status 404 returned error can't find the container with id 24270351f90b4622621038da3d577abb7561ebd17d701c5150c75e2266236040
Oct 30 07:33:59.941211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:33:59.940954    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"]
Oct 30 07:34:00.126213 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:00.126168    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" event={"ID":"a9f962fc-0cec-4652-b269-db7a6b81d5e6","Type":"ContainerStarted","Data":"24270351f90b4622621038da3d577abb7561ebd17d701c5150c75e2266236040"}
Oct 30 07:34:01.134534 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:01.134491    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" event={"ID":"a9f962fc-0cec-4652-b269-db7a6b81d5e6","Type":"ContainerStarted","Data":"780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48"}
Oct 30 07:34:01.135041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:01.134572    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:34:01.178683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:01.178628    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" podStartSLOduration=2.800120124 podStartE2EDuration="3.178614801s" totalImagesPullingTime="378.494677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:34:01.176753151 +0000 UTC m=+2243.884633321" watchObservedRunningTime="2026-10-30 07:34:01.178614801 +0000 UTC m=+2243.886494969"
Oct 30 07:34:07.147776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:07.147746    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 07:34:13.925155 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:34:13.925113    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:34:32.142974 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.142930    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"]
Oct 30 07:34:32.148595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.148571    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.178594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.175812    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-f1f700-serving-cert\""
Oct 30 07:34:32.181795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.181765    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"]
Oct 30 07:34:32.245435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.245402    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.245624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.245590    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.245734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.245711    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.245806 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.245791    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg6w4\" (UniqueName: \"kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.347082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.347043    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg6w4\" (UniqueName: \"kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.347247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.347126    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.347247 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.347240    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.347392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.347302    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.347993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.347965    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.349978 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.349937    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.358930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.350013    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.418123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.414200    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg6w4\" (UniqueName: \"kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4\") pod \"maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.463118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.463087    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:32.783104 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:34:32.783073    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ac61ee_4295_47b7_b71a_939a37cb3d39.slice/crio-cc64b8c0e7f12dc438d7889e7ed9c1e1a39db937010e10c4b983053d29949e00 WatchSource:0}: Error finding container cc64b8c0e7f12dc438d7889e7ed9c1e1a39db937010e10c4b983053d29949e00: Status 404 returned error can't find the container with id cc64b8c0e7f12dc438d7889e7ed9c1e1a39db937010e10c4b983053d29949e00
Oct 30 07:34:32.783452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:32.783433    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"]
Oct 30 07:34:33.441386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:33.441305    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p" event={"ID":"69ac61ee-4295-47b7-b71a-939a37cb3d39","Type":"ContainerStarted","Data":"993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b"}
Oct 30 07:34:33.441386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:33.441350    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p" event={"ID":"69ac61ee-4295-47b7-b71a-939a37cb3d39","Type":"ContainerStarted","Data":"cc64b8c0e7f12dc438d7889e7ed9c1e1a39db937010e10c4b983053d29949e00"}
Oct 30 07:34:33.441386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:33.441381    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:33.485205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:33.485150    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p" podStartSLOduration=1.082789232 podStartE2EDuration="1.485136477s" totalImagesPullingTime="402.347245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:34:33.481377938 +0000 UTC m=+2276.189258127" watchObservedRunningTime="2026-10-30 07:34:33.485136477 +0000 UTC m=+2276.193016666"
Oct 30 07:34:39.453300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:39.453268    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 07:34:43.925011 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:34:43.924973    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:34:57.793070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:57.793034    5073 generic.go:356] "Generic (PLEG): container finished" podID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerID="52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51" exitCode=0
Oct 30 07:34:57.793558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:57.793116    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" event={"ID":"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d","Type":"ContainerDied","Data":"52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"}
Oct 30 07:34:57.793558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:57.793499    5073 scope.go:122] "RemoveContainer" containerID="52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"
Oct 30 07:34:57.795703 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:57.795663    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:34:57.795842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:57.795756    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:34:57.795842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:57.795806    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:34:58.807768 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:58.807727    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" event={"ID":"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d","Type":"ContainerStarted","Data":"60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c"}
Oct 30 07:34:59.473706 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:59.473673    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:34:59.474147 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:59.474121    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 07:34:59.474339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:34:59.474314    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 07:35:00.483206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:00.483167    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 07:35:00.483810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:00.483777    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 07:35:01.488518 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:01.488477    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 07:35:01.489158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:01.489125    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 07:35:01.611332 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:01.611298    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:35:02.490555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:02.490509    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 07:35:02.491113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:02.490574    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 07:35:02.646752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:02.646717    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"]
Oct 30 07:35:02.835911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:02.835811    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy" containerID="cri-o://3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621" gracePeriod=30
Oct 30 07:35:03.472285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:03.472244    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused" start-of-body=
Oct 30 07:35:03.472574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:03.472545    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.157:15021/healthz/ready\": dial tcp 10.132.0.157:15021: connect: connection refused"
Oct 30 07:35:04.561826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:04.561793    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:35:04.563522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:04.563497    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 07:35:08.143540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.143508    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:35:08.242735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.242700    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.242925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.242759    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.242925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.242820    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.242925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.242876    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.243124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.242987    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.243124 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243041    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.243235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243119    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.243235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243198    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.243355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243240    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:35:08.243355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243245    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket\") pod \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\" (UID: \"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7\") "
Oct 30 07:35:08.243461 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243446    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:35:08.243649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243594    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:35:08.243649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243644    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:35:08.243895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.243686    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:35:08.244279 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.244251    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.244399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.244282    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.244399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.244297    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.244399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.244324    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.244399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.244341    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.245973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.245941    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:35:08.245973 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.245950    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "kube-api-access-jktbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:35:08.246148 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.245999    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:35:08.246307 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.246288    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token" pod "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" (UID: "6ed3b29a-52b7-49cb-bafb-aef1663e8cb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:35:08.345439 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.345406    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.345439 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.345432    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.345439 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.345441    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jktbr\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-kube-api-access-jktbr\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.345681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.345450    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:35:08.882618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.882583    5073 generic.go:356] "Generic (PLEG): container finished" podID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerID="3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621" exitCode=0
Oct 30 07:35:08.882804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.882631    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"
Oct 30 07:35:08.882804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.882663    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" event={"ID":"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7","Type":"ContainerDied","Data":"3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621"}
Oct 30 07:35:08.882804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.882715    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf" event={"ID":"6ed3b29a-52b7-49cb-bafb-aef1663e8cb7","Type":"ContainerDied","Data":"24be4ba4a1da06af461c15e67e4c3ebb385834fba1b1f8d599401ff0995f2688"}
Oct 30 07:35:08.882804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.882739    5073 scope.go:122] "RemoveContainer" containerID="3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621"
Oct 30 07:35:08.894919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.894898    5073 scope.go:122] "RemoveContainer" containerID="3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621"
Oct 30 07:35:08.895217 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:35:08.895197    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621\": container with ID starting with 3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621 not found: ID does not exist" containerID="3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621"
Oct 30 07:35:08.895294 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:08.895227    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621"} err="failed to get container status \"3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621\": rpc error: code = NotFound desc = could not find container \"3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621\": container with ID starting with 3b79efb3307bb64ffbf5e1c981f376aff1d05ad32f364f44078841295d9f7621 not found: ID does not exist"
Oct 30 07:35:09.018227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:09.018192    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"]
Oct 30 07:35:09.042873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:09.036386    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-8gntf"]
Oct 30 07:35:09.426144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:35:09.426110    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" path="/var/lib/kubelet/pods/6ed3b29a-52b7-49cb-bafb-aef1663e8cb7/volumes"
Oct 30 07:35:13.925765 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:35:13.925683    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:35:43.925829 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:35:43.925792    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:36:14.085753 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:36:14.085713    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:36:18.364227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.364145    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"]
Oct 30 07:36:18.365320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.365294    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy"
Oct 30 07:36:18.365320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.365317    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy"
Oct 30 07:36:18.365530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.365444    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ed3b29a-52b7-49cb-bafb-aef1663e8cb7" containerName="istio-proxy"
Oct 30 07:36:18.369557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.369534    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.384567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.384528    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-e27e0c-openshift-default-dockercfg-zfnz2\""
Oct 30 07:36:18.405235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.405205    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"]
Oct 30 07:36:18.475613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.475571    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.475821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.475784    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.475929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.475838    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.476023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.475997    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.476079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.476065    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.476240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.476224    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m82q\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.476313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.476298    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.476388 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.476374    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.476435 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.476413    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.579250 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.579208    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m82q\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.580261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.580231    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.580485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.580466    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.581150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.581130    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.581720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.581700    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.582460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.582442    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.582929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.582909    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.583735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.583716    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.584221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.584203    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.589354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.589336    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.589651 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.584117    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.604754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.583642    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.604917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.589263    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.605013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.582324    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.623704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.610357    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.624631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.624605    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m82q\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.625075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.625021    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.628288 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.628267    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token\") pod \"e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") " pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:18.697517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:18.697477    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:19.130885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.125273    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"]
Oct 30 07:36:19.131818 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.131773    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:36:19.131958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.131891    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:36:19.131958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.131936    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:36:19.755760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.755723    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" event={"ID":"40daf937-243d-4106-8b1b-fbeb5077765c","Type":"ContainerStarted","Data":"07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"}
Oct 30 07:36:19.756146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.755785    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" event={"ID":"40daf937-243d-4106-8b1b-fbeb5077765c","Type":"ContainerStarted","Data":"88b84e8cb2ac92867f6e3d7ae6d866e2066c027bcf1fcdaaf1f79c81dd145fc0"}
Oct 30 07:36:19.813427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:19.813371    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podStartSLOduration=1.8133565219999999 podStartE2EDuration="1.813356522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:36:19.81099164 +0000 UTC m=+2382.518871808" watchObservedRunningTime="2026-10-30 07:36:19.813356522 +0000 UTC m=+2382.521236691"
Oct 30 07:36:20.699875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:20.699811    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:20.708135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:20.708108    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:20.763361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:20.763326    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:20.764087 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:20.764067    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:36:38.056915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:38.056882    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:36:38.059928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:36:38.059905    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:36:43.929057 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:36:43.929015    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:37:10.695023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.694983    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"]
Oct 30 07:37:10.699574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.699552    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.732102 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.732072    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-e27e0c-serving-cert\""
Oct 30 07:37:10.739920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.739891    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"]
Oct 30 07:37:10.803929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.803893    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht8pv\" (UniqueName: \"kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.804128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.804038    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.804199 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.804142    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.804258 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.804209    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.905744 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.905704    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht8pv\" (UniqueName: \"kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.905980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.905804    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.905980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.905898    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.905980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.905957    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.906666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.906633    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.908773 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.908741    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.908941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.908877    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:10.928133 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:10.928109    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht8pv\" (UniqueName: \"kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv\") pod \"maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:11.020964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:11.020880    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:11.382224 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:37:11.382179    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90aae629_aa1b_47a8_9175_ed746e57fe00.slice/crio-39ddc991ccd3d18d1c22fc4ec76d154bc5d9a0f6d04674eafe7d0620d9d3eece WatchSource:0}: Error finding container 39ddc991ccd3d18d1c22fc4ec76d154bc5d9a0f6d04674eafe7d0620d9d3eece: Status 404 returned error can't find the container with id 39ddc991ccd3d18d1c22fc4ec76d154bc5d9a0f6d04674eafe7d0620d9d3eece
Oct 30 07:37:11.382911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:11.382820    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"]
Oct 30 07:37:12.368206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:12.368174    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn" event={"ID":"90aae629-aa1b-47a8-9175-ed746e57fe00","Type":"ContainerStarted","Data":"f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc"}
Oct 30 07:37:12.368623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:12.368224    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn" event={"ID":"90aae629-aa1b-47a8-9175-ed746e57fe00","Type":"ContainerStarted","Data":"39ddc991ccd3d18d1c22fc4ec76d154bc5d9a0f6d04674eafe7d0620d9d3eece"}
Oct 30 07:37:12.368623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:12.368381    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:12.411387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:12.411325    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn" podStartSLOduration=1.9248395029999998 podStartE2EDuration="2.411307098s" totalImagesPullingTime="486.467595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:37:12.408808737 +0000 UTC m=+2435.116688906" watchObservedRunningTime="2026-10-30 07:37:12.411307098 +0000 UTC m=+2435.119187269"
Oct 30 07:37:13.922759 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:37:13.922715    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:37:18.382895 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:18.382826    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 07:37:41.302411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:41.302367    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"]
Oct 30 07:37:41.303297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:41.303261    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy" containerID="cri-o://5356606c9e1a94b3f04bfb070ff92d37c14546e0774f71c68f869aa1f87a64f6" gracePeriod=30
Oct 30 07:37:44.127771 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:37:44.127732    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:37:44.432799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:44.432711    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"]
Oct 30 07:37:44.433322 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:44.433287    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy" containerID="cri-o://01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e" gracePeriod=30
Oct 30 07:37:46.879271 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:46.879228    5073 generic.go:356] "Generic (PLEG): container finished" podID="5aa4b615-5135-4383-a4f2-6f8158543704" containerID="5356606c9e1a94b3f04bfb070ff92d37c14546e0774f71c68f869aa1f87a64f6" exitCode=0
Oct 30 07:37:46.879619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:46.879305    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" event={"ID":"5aa4b615-5135-4383-a4f2-6f8158543704","Type":"ContainerDied","Data":"5356606c9e1a94b3f04bfb070ff92d37c14546e0774f71c68f869aa1f87a64f6"}
Oct 30 07:37:46.879619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:46.879408    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj" event={"ID":"5aa4b615-5135-4383-a4f2-6f8158543704","Type":"ContainerDied","Data":"0f440da42f75c30b280e0f6080291c1e0d3bb2f6a3ab22ecdd14e593a88df4a5"}
Oct 30 07:37:46.879619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:46.879458    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f440da42f75c30b280e0f6080291c1e0d3bb2f6a3ab22ecdd14e593a88df4a5"
Oct 30 07:37:46.880162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:46.880139    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:37:47.071772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071685    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.071772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071726    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.071772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071768    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071822    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071945    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071985    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.071991    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:47.072304 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072081    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072304 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072143    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072304 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072190    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket\") pod \"5aa4b615-5135-4383-a4f2-6f8158543704\" (UID: \"5aa4b615-5135-4383-a4f2-6f8158543704\") "
Oct 30 07:37:47.072304 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072287    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:37:47.072659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072593    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:47.072794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072671    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:47.072794 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072745    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:47.072982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072961    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.073032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.072990    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.073032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.073006    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.073032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.073022    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.073135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.073036    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5aa4b615-5135-4383-a4f2-6f8158543704-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.074306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.074282    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:47.074570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.074551    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "kube-api-access-9sbzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:37:47.074662 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.074637    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:37:47.074884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.074865    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token" pod "5aa4b615-5135-4383-a4f2-6f8158543704" (UID: "5aa4b615-5135-4383-a4f2-6f8158543704"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:37:47.174303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.174269    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sbzl\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-kube-api-access-9sbzl\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.174303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.174300    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5aa4b615-5135-4383-a4f2-6f8158543704-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.174303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.174310    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5aa4b615-5135-4383-a4f2-6f8158543704-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.174572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.174319    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5aa4b615-5135-4383-a4f2-6f8158543704-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:47.917372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.915084    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"
Oct 30 07:37:47.984718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.984675    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"]
Oct 30 07:37:47.995249 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:47.995210    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-5skrj"]
Oct 30 07:37:48.743992 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:48.743950    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"]
Oct 30 07:37:48.744221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:48.744190    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" containerID="cri-o://186e5a78eda65b1d467c5a195496252257156fcc04cf3c3dc31019ee517b2bc9" gracePeriod=30
Oct 30 07:37:49.425172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.425136    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" path="/var/lib/kubelet/pods/5aa4b615-5135-4383-a4f2-6f8158543704/volumes"
Oct 30 07:37:49.753041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.753014    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:37:49.848324 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.848287    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.848533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.848365    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.848533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.848419    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.848533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.848501    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.848815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.848787    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:49.848948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.848921    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:37:49.849118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849091    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.849246 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849150    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.849427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849361    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:49.849427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849368    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.849570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849442    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.849570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849494    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket\") pod \"a6662718-864f-44d1-adec-9fcca8d93b24\" (UID: \"a6662718-864f-44d1-adec-9fcca8d93b24\") "
Oct 30 07:37:49.849726 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849705    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:49.849928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.849898    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:49.850236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.850214    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.850317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.850242    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.850317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.850259    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.850317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.850275    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6662718-864f-44d1-adec-9fcca8d93b24-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.850317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.850288    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.851456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.851433    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:37:49.851700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.851673    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:49.851771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.851715    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "kube-api-access-6n8g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:37:49.852081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.852058    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo" pod "a6662718-864f-44d1-adec-9fcca8d93b24" (UID: "a6662718-864f-44d1-adec-9fcca8d93b24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:37:49.951314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.951273    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6662718-864f-44d1-adec-9fcca8d93b24-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.951314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.951305    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6662718-864f-44d1-adec-9fcca8d93b24-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.951314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.951318    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n8g2\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-kube-api-access-6n8g2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.951544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.951332    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6662718-864f-44d1-adec-9fcca8d93b24-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:49.985175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.985092    5073 generic.go:356] "Generic (PLEG): container finished" podID="a6662718-864f-44d1-adec-9fcca8d93b24" containerID="01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e" exitCode=0
Oct 30 07:37:49.985175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.985141    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"
Oct 30 07:37:49.985175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.985166    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" event={"ID":"a6662718-864f-44d1-adec-9fcca8d93b24","Type":"ContainerDied","Data":"01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e"}
Oct 30 07:37:49.985470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.985220    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z" event={"ID":"a6662718-864f-44d1-adec-9fcca8d93b24","Type":"ContainerDied","Data":"199b3e665d42b592ecf5f0e2e67e5f3855a227d5e7aed2955cbe1b2d1d83cf6e"}
Oct 30 07:37:49.985470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.985247    5073 scope.go:122] "RemoveContainer" containerID="01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e"
Oct 30 07:37:49.997732 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.997707    5073 scope.go:122] "RemoveContainer" containerID="01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e"
Oct 30 07:37:49.998107 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:37:49.998085    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e\": container with ID starting with 01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e not found: ID does not exist" containerID="01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e"
Oct 30 07:37:49.998206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:49.998116    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e"} err="failed to get container status \"01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e\": rpc error: code = NotFound desc = could not find container \"01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e\": container with ID starting with 01290aad455ec44a22c3d48de8c36fc59426727d239fd360f9d9d2f106f3656e not found: ID does not exist"
Oct 30 07:37:50.036723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:50.036690    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"]
Oct 30 07:37:50.045795 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:50.045761    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-9vl8z"]
Oct 30 07:37:51.152960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:51.151490    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": read tcp 10.132.0.2:36592->10.132.0.161:15021: read: connection reset by peer" start-of-body=
Oct 30 07:37:51.152960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:51.151584    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": read tcp 10.132.0.2:36592->10.132.0.161:15021: read: connection reset by peer"
Oct 30 07:37:51.424536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:51.424451    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" path="/var/lib/kubelet/pods/a6662718-864f-44d1-adec-9fcca8d93b24/volumes"
Oct 30 07:37:52.047718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.047681    5073 generic.go:356] "Generic (PLEG): container finished" podID="40daf937-243d-4106-8b1b-fbeb5077765c" containerID="07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29" exitCode=0
Oct 30 07:37:52.047944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.047750    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" event={"ID":"40daf937-243d-4106-8b1b-fbeb5077765c","Type":"ContainerDied","Data":"07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"}
Oct 30 07:37:52.048257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.048239    5073 scope.go:122] "RemoveContainer" containerID="07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"
Oct 30 07:37:52.050252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.050223    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:37:52.050365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.050304    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:37:52.050365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.050334    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:37:52.789031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.788990    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:37:52.789672 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:52.789630    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:37:53.057506 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:53.057421    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" event={"ID":"40daf937-243d-4106-8b1b-fbeb5077765c","Type":"ContainerStarted","Data":"094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce"}
Oct 30 07:37:53.701891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:53.700283    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:37:53.701891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:53.700427    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused" start-of-body=
Oct 30 07:37:53.701891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:53.700472    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused"
Oct 30 07:37:54.066555 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.066524    5073 generic.go:356] "Generic (PLEG): container finished" podID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerID="186e5a78eda65b1d467c5a195496252257156fcc04cf3c3dc31019ee517b2bc9" exitCode=0
Oct 30 07:37:54.067081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.066818    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" event={"ID":"8edbd30a-3295-4e9e-bfaa-6587a6e732ac","Type":"ContainerDied","Data":"186e5a78eda65b1d467c5a195496252257156fcc04cf3c3dc31019ee517b2bc9"}
Oct 30 07:37:54.067081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.066888    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk" event={"ID":"8edbd30a-3295-4e9e-bfaa-6587a6e732ac","Type":"ContainerDied","Data":"9874663a325537da27b250098df8ede1f681a9d1117b04de2f7ca651dc2b20c1"}
Oct 30 07:37:54.067081 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.066920    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9874663a325537da27b250098df8ede1f681a9d1117b04de2f7ca651dc2b20c1"
Oct 30 07:37:54.114347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.114317    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:37:54.239971 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.239935    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240016    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240128    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240222 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240211    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240251    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240303    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240381    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240494    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240503    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240521    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240548    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240622    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token\") pod \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\" (UID: \"8edbd30a-3295-4e9e-bfaa-6587a6e732ac\") "
Oct 30 07:37:54.240743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.240669    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:54.241385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.241305    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.241385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.241334    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.241385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.241349    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.241385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.241362    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.241668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.241424    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:37:54.243196 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.243169    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "kube-api-access-p545t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:37:54.243459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.243437    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:37:54.243630 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.243606    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:37:54.243820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.243797    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo" pod "8edbd30a-3295-4e9e-bfaa-6587a6e732ac" (UID: "8edbd30a-3295-4e9e-bfaa-6587a6e732ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:37:54.342665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.342587    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p545t\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-kube-api-access-p545t\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.342665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.342617    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.342665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.342626    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.342665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.342635    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.342665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.342643    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8edbd30a-3295-4e9e-bfaa-6587a6e732ac-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:37:54.701244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.701204    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused" start-of-body=
Oct 30 07:37:54.701532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:54.701506    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused"
Oct 30 07:37:55.098938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:55.097416    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"
Oct 30 07:37:55.164943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:55.164903    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"]
Oct 30 07:37:55.190873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:55.185598    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-rctsk"]
Oct 30 07:37:55.424082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:55.424047    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" path="/var/lib/kubelet/pods/8edbd30a-3295-4e9e-bfaa-6587a6e732ac/volumes"
Oct 30 07:37:55.701925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:55.701210    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused" start-of-body=
Oct 30 07:37:55.701925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:55.701270    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused"
Oct 30 07:37:56.342793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:56.342758    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"]
Oct 30 07:37:56.343277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:56.342968    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy" containerID="cri-o://6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f" gracePeriod=30
Oct 30 07:37:56.356473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:56.356444    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"]
Oct 30 07:37:56.356696 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:56.356671    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy" containerID="cri-o://3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2" gracePeriod=30
Oct 30 07:37:56.699876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:56.699222    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused" start-of-body=
Oct 30 07:37:56.699876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:56.699286    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused"
Oct 30 07:37:57.702592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:57.702556    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused" start-of-body=
Oct 30 07:37:57.703279 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:57.703231    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": dial tcp 10.132.0.161:15021: connect: connection refused"
Oct 30 07:37:58.704946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:58.704915    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:37:58.705439 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:58.705423    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:37:58.706276 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:37:58.706253    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 07:38:01.668902 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.668870    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:38:01.697993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.697959    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698024    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698063    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698107    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698143    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698183    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698329    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698493 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698445    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.698560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.698538    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket\") pod \"6bb06e50-2da3-4e7c-ac11-396d297cb947\" (UID: \"6bb06e50-2da3-4e7c-ac11-396d297cb947\") "
Oct 30 07:38:01.699353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.699116    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.699353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.699207    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.699353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.699280    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.699580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.699376    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.699962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.699912    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:38:01.700634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.700609    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:01.700716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.700694    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.700822 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.700799    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "kube-api-access-jr569". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:01.701530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.701509    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo" pod "6bb06e50-2da3-4e7c-ac11-396d297cb947" (UID: "6bb06e50-2da3-4e7c-ac11-396d297cb947"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:38:01.706228 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.706203    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:38:01.799649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799615    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.799863 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799685    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.799863 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799748    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.799863 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799830    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.800054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799874    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.800054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799939    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.800054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799998    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.800054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.799997    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.800054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.800051    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.800331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.800064    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.800331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.800209    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket\") pod \"6d0721c6-5ad3-401e-befd-b9133fb493a7\" (UID: \"6d0721c6-5ad3-401e-befd-b9133fb493a7\") "
Oct 30 07:38:01.800449 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.800343    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:38:01.800847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.800607    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.800847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.800822    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.801227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801203    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb06e50-2da3-4e7c-ac11-396d297cb947-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801233    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801246    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801261    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801275    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801286    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801300    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801312    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801326    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801341    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr569\" (UniqueName: \"kubernetes.io/projected/6bb06e50-2da3-4e7c-ac11-396d297cb947-kube-api-access-jr569\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801354    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801384    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801397    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0721c6-5ad3-401e-befd-b9133fb493a7-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.801800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.801410    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb06e50-2da3-4e7c-ac11-396d297cb947-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.803029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.803004    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:38:01.803349 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.803323    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:01.803474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.803458    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "kube-api-access-rhdrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:01.803577 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.803563    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token" pod "6d0721c6-5ad3-401e-befd-b9133fb493a7" (UID: "6d0721c6-5ad3-401e-befd-b9133fb493a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:01.903469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.903377    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.903469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.903419    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhdrq\" (UniqueName: \"kubernetes.io/projected/6d0721c6-5ad3-401e-befd-b9133fb493a7-kube-api-access-rhdrq\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.903469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.903438    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:01.903469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:01.903451    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0721c6-5ad3-401e-befd-b9133fb493a7-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:02.162318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.162224    5073 generic.go:356] "Generic (PLEG): container finished" podID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerID="3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2" exitCode=0
Oct 30 07:38:02.162318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.162265    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"
Oct 30 07:38:02.162536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.162305    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" event={"ID":"6d0721c6-5ad3-401e-befd-b9133fb493a7","Type":"ContainerDied","Data":"3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2"}
Oct 30 07:38:02.162536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.162363    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr" event={"ID":"6d0721c6-5ad3-401e-befd-b9133fb493a7","Type":"ContainerDied","Data":"dcd582d3ca72dd1582828ed35d40a04b003beed4ddb9b7b332685236a4aafd86"}
Oct 30 07:38:02.162536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.162393    5073 scope.go:122] "RemoveContainer" containerID="3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2"
Oct 30 07:38:02.163842 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.163810    5073 generic.go:356] "Generic (PLEG): container finished" podID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerID="6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f" exitCode=0
Oct 30 07:38:02.163996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.163878    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"
Oct 30 07:38:02.163996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.163883    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" event={"ID":"6bb06e50-2da3-4e7c-ac11-396d297cb947","Type":"ContainerDied","Data":"6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f"}
Oct 30 07:38:02.163996 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.163950    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp" event={"ID":"6bb06e50-2da3-4e7c-ac11-396d297cb947","Type":"ContainerDied","Data":"9f6152642861c5aef12ccb5110a5a895df6cf9f321011ca9eaffc1edf09487a9"}
Oct 30 07:38:02.174660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.174623    5073 scope.go:122] "RemoveContainer" containerID="3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2"
Oct 30 07:38:02.175063 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:38:02.175035    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2\": container with ID starting with 3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2 not found: ID does not exist" containerID="3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2"
Oct 30 07:38:02.175162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.175071    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2"} err="failed to get container status \"3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2\": rpc error: code = NotFound desc = could not find container \"3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2\": container with ID starting with 3afb20aa767a8ddeb657fccd17aa9129dd52d8ed9b3d694ad201a66050acfec2 not found: ID does not exist"
Oct 30 07:38:02.175162 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.175095    5073 scope.go:122] "RemoveContainer" containerID="6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f"
Oct 30 07:38:02.187063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.187033    5073 scope.go:122] "RemoveContainer" containerID="6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f"
Oct 30 07:38:02.187463 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:38:02.187438    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f\": container with ID starting with 6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f not found: ID does not exist" containerID="6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f"
Oct 30 07:38:02.187528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.187475    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f"} err="failed to get container status \"6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f\": rpc error: code = NotFound desc = could not find container \"6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f\": container with ID starting with 6a6233fffdb7e508d4fcd8190f59fd01d6a83f78653ec4da605d057a28131b9f not found: ID does not exist"
Oct 30 07:38:02.214463 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.214432    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"]
Oct 30 07:38:02.218449 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.218420    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-4hgtp"]
Oct 30 07:38:02.252623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.252590    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"]
Oct 30 07:38:02.256030 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:02.256003    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-265384-openshift-default-6f9c67dbfc-gr2cr"]
Oct 30 07:38:03.434128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:03.434088    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" path="/var/lib/kubelet/pods/6bb06e50-2da3-4e7c-ac11-396d297cb947/volumes"
Oct 30 07:38:03.434621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:03.434607    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" path="/var/lib/kubelet/pods/6d0721c6-5ad3-401e-befd-b9133fb493a7/volumes"
Oct 30 07:38:13.922987 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:38:13.922950    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:38:32.608887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.608836    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"]
Oct 30 07:38:32.609882 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609847    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy"
Oct 30 07:38:32.609936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609885    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy"
Oct 30 07:38:32.609936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609916    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy"
Oct 30 07:38:32.609936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609924    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy"
Oct 30 07:38:32.610032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609939    5073 cpu_manager.go:414] "containerMap: removing container" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy"
Oct 30 07:38:32.610032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609948    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy"
Oct 30 07:38:32.610032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609975    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy"
Oct 30 07:38:32.610032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.609983    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy"
Oct 30 07:38:32.610032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610022    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy"
Oct 30 07:38:32.610032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610029    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy"
Oct 30 07:38:32.610211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610184    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d0721c6-5ad3-401e-befd-b9133fb493a7" containerName="istio-proxy"
Oct 30 07:38:32.610211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610195    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="8edbd30a-3295-4e9e-bfaa-6587a6e732ac" containerName="istio-proxy"
Oct 30 07:38:32.610315 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610209    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6662718-864f-44d1-adec-9fcca8d93b24" containerName="istio-proxy"
Oct 30 07:38:32.610315 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610223    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aa4b615-5135-4383-a4f2-6f8158543704" containerName="istio-proxy"
Oct 30 07:38:32.610315 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.610237    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bb06e50-2da3-4e7c-ac11-396d297cb947" containerName="istio-proxy"
Oct 30 07:38:32.622536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.622512    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.634180 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.634154    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"]
Oct 30 07:38:32.641377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.640979    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-f1f700\"/\"openshift-service-ca.crt\""
Oct 30 07:38:32.641377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.641021    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-f1f700\"/\"agc-cred-2c0ab0fb80d7\""
Oct 30 07:38:32.641377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.641022    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-f1f700\"/\"kube-root-ca.crt\""
Oct 30 07:38:32.641377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.641049    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-f1f700\"/\"payload-processing-external-model-plugins-e2e-extmod-b-f1f700\""
Oct 30 07:38:32.641377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.641120    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-f1f700\"/\"payload-processing-external-model-e2e--96fc5bc0-dockercfg-tlgdn\""
Oct 30 07:38:32.641377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.641151    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-f1f700\"/\"routing-overlay\""
Oct 30 07:38:32.651591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.651560    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.651733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.651613    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.651800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.651764    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6tc\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.651884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.651813    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.753440 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.753405    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.753635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.753458    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.753635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.753501    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6tc\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.753635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.753531    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.754328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.754294    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.754741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.754714    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.758650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.758624    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.778244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.778224    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6tc\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc\") pod \"payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") " pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:32.938195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:32.938166    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:33.477593 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:33.477503    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"]
Oct 30 07:38:34.547877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:34.546820    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg" event={"ID":"1447e674-1452-4b36-9688-0b50766d6a9b","Type":"ContainerStarted","Data":"5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976"}
Oct 30 07:38:34.547877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:34.546901    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg" event={"ID":"1447e674-1452-4b36-9688-0b50766d6a9b","Type":"ContainerStarted","Data":"3a16ba08d829eb1c6d769da7eca339b8792d6f2ae044c10149f7ed441af01c12"}
Oct 30 07:38:34.548428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:34.548012    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:34.640238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:34.640189    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg" podStartSLOduration=2.640174973 podStartE2EDuration="2.640174973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:38:34.635632144 +0000 UTC m=+2517.343512314" watchObservedRunningTime="2026-10-30 07:38:34.640174973 +0000 UTC m=+2517.348055142"
Oct 30 07:38:35.629095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.629062    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"]
Oct 30 07:38:35.633981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.633961    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.652517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.652490    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-a-0f5081\"/\"e2e-cfl-0ed31f-provider-cred\""
Oct 30 07:38:35.664007 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.663983    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-a-0f5081\"/\"payload-processing-external-model-e2e--8bb4c319-dockercfg-w92sm\""
Oct 30 07:38:35.664226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.664203    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-0f5081\"/\"payload-processing-external-model-plugins-e2e-extmod-a-0f5081\""
Oct 30 07:38:35.664341 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.664323    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-0f5081\"/\"kube-root-ca.crt\""
Oct 30 07:38:35.664493 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.664476    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-0f5081\"/\"routing-overlay\""
Oct 30 07:38:35.664579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.664515    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-0f5081\"/\"openshift-service-ca.crt\""
Oct 30 07:38:35.669845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.669821    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"]
Oct 30 07:38:35.715476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.715446    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.715617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.715578    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.715682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.715668    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpzrx\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.715717 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.715697    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.817238 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.817201    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.817398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.817333    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.817453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.817401    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpzrx\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.817453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.817439    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.818185 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.818160    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.818433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.818409    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.820305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.820284    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.840421 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.840395    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpzrx\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx\") pod \"payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") " pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:35.989240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:35.989152    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:36.310041 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:36.310006    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"]
Oct 30 07:38:36.311563 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:38:36.311538    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8acd9c_cb1a_40a8_b9c0_b8a6a1fec9de.slice/crio-a94ce91281d7c8d569289ef128a5604f8127d4a4de03c933d73b0a11bde3763f WatchSource:0}: Error finding container a94ce91281d7c8d569289ef128a5604f8127d4a4de03c933d73b0a11bde3763f: Status 404 returned error can't find the container with id a94ce91281d7c8d569289ef128a5604f8127d4a4de03c933d73b0a11bde3763f
Oct 30 07:38:36.575932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:36.571679    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr" event={"ID":"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de","Type":"ContainerStarted","Data":"f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6"}
Oct 30 07:38:36.575932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:36.571774    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr" event={"ID":"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de","Type":"ContainerStarted","Data":"a94ce91281d7c8d569289ef128a5604f8127d4a4de03c933d73b0a11bde3763f"}
Oct 30 07:38:36.575932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:36.571825    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:36.656883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:36.645654    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr" podStartSLOduration=1.645633176 podStartE2EDuration="1.645633176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:38:36.638329162 +0000 UTC m=+2519.346209330" watchObservedRunningTime="2026-10-30 07:38:36.645633176 +0000 UTC m=+2519.353513346"
Oct 30 07:38:38.446599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:38.446558    5073 scope.go:122] "RemoveContainer" containerID="186e5a78eda65b1d467c5a195496252257156fcc04cf3c3dc31019ee517b2bc9"
Oct 30 07:38:38.469350 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:38.469325    5073 scope.go:122] "RemoveContainer" containerID="5356606c9e1a94b3f04bfb070ff92d37c14546e0774f71c68f869aa1f87a64f6"
Oct 30 07:38:43.806475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:43.806438    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"]
Oct 30 07:38:43.809512 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:43.809490    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:43.927817 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:38:43.927770    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:38:48.438328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:48.438294    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"]
Oct 30 07:38:48.438823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:48.438503    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy" containerID="cri-o://5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf" gracePeriod=30
Oct 30 07:38:48.588622 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:48.588588    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:38:48.807458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:48.807355    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg" podUID="1447e674-1452-4b36-9688-0b50766d6a9b" containerName="payload-processing" containerID="cri-o://5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976" gracePeriod=25
Oct 30 07:38:49.114818 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.114787    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:49.245103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245066    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume\") pod \"1447e674-1452-4b36-9688-0b50766d6a9b\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") "
Oct 30 07:38:49.245280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245212    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume\") pod \"1447e674-1452-4b36-9688-0b50766d6a9b\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") "
Oct 30 07:38:49.245280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245233    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials\") pod \"1447e674-1452-4b36-9688-0b50766d6a9b\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") "
Oct 30 07:38:49.245397 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245347    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc\") pod \"1447e674-1452-4b36-9688-0b50766d6a9b\" (UID: \"1447e674-1452-4b36-9688-0b50766d6a9b\") "
Oct 30 07:38:49.245536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245506    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume" pod "1447e674-1452-4b36-9688-0b50766d6a9b" (UID: "1447e674-1452-4b36-9688-0b50766d6a9b"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:38:49.245607 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245532    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume" pod "1447e674-1452-4b36-9688-0b50766d6a9b" (UID: "1447e674-1452-4b36-9688-0b50766d6a9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:38:49.245936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245915    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:49.246034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.245939    5073 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/1447e674-1452-4b36-9688-0b50766d6a9b-routing-overlay-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:49.247626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.247604    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc" pod "1447e674-1452-4b36-9688-0b50766d6a9b" (UID: "1447e674-1452-4b36-9688-0b50766d6a9b"). InnerVolumeSpecName "kube-api-access-dq6tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:49.247689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.247618    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials" pod "1447e674-1452-4b36-9688-0b50766d6a9b" (UID: "1447e674-1452-4b36-9688-0b50766d6a9b"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:49.347884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.347766    5073 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-provider-credentials\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:49.347884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.347797    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq6tc\" (UniqueName: \"kubernetes.io/projected/1447e674-1452-4b36-9688-0b50766d6a9b-kube-api-access-dq6tc\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:49.699055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.699014    5073 generic.go:356] "Generic (PLEG): container finished" podID="1447e674-1452-4b36-9688-0b50766d6a9b" containerID="5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976" exitCode=0
Oct 30 07:38:49.699470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.699079    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"
Oct 30 07:38:49.699470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.699100    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg" event={"ID":"1447e674-1452-4b36-9688-0b50766d6a9b","Type":"ContainerDied","Data":"5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976"}
Oct 30 07:38:49.699470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.699206    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg" event={"ID":"1447e674-1452-4b36-9688-0b50766d6a9b","Type":"ContainerDied","Data":"3a16ba08d829eb1c6d769da7eca339b8792d6f2ae044c10149f7ed441af01c12"}
Oct 30 07:38:49.699470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.699237    5073 scope.go:122] "RemoveContainer" containerID="5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976"
Oct 30 07:38:49.709928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.709909    5073 scope.go:122] "RemoveContainer" containerID="5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976"
Oct 30 07:38:49.710208 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:38:49.710184    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976\": container with ID starting with 5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976 not found: ID does not exist" containerID="5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976"
Oct 30 07:38:49.710313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.710216    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976"} err="failed to get container status \"5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976\": rpc error: code = NotFound desc = could not find container \"5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976\": container with ID starting with 5f9234cdc2c75888704115eddade9ee852d095b1da3c815ec0c3004ef8e20976 not found: ID does not exist"
Oct 30 07:38:49.749596 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.749564    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"]
Oct 30 07:38:49.760560 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:49.760529    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-b-f1f700/payload-processing-external-model-e2e-extmod-b-f1f700-77f5n2ddg"]
Oct 30 07:38:51.423631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:51.423599    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1447e674-1452-4b36-9688-0b50766d6a9b" path="/var/lib/kubelet/pods/1447e674-1452-4b36-9688-0b50766d6a9b/volumes"
Oct 30 07:38:53.722029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.721927    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:38:53.739218 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.739178    5073 generic.go:356] "Generic (PLEG): container finished" podID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerID="5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf" exitCode=0
Oct 30 07:38:53.739465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.739444    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"
Oct 30 07:38:53.739595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.739319    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" event={"ID":"03903cb4-dd8c-439d-b855-68127f4b7ad1","Type":"ContainerDied","Data":"5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf"}
Oct 30 07:38:53.739677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.739664    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc" event={"ID":"03903cb4-dd8c-439d-b855-68127f4b7ad1","Type":"ContainerDied","Data":"3f4d339ac0fc78422918aa05bf6ff6e411ebefa3027c362c7f25313d142be55e"}
Oct 30 07:38:53.739733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.739711    5073 scope.go:122] "RemoveContainer" containerID="5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf"
Oct 30 07:38:53.753640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.753618    5073 scope.go:122] "RemoveContainer" containerID="5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf"
Oct 30 07:38:53.753946 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:38:53.753927    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf\": container with ID starting with 5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf not found: ID does not exist" containerID="5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf"
Oct 30 07:38:53.754013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.753953    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf"} err="failed to get container status \"5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf\": rpc error: code = NotFound desc = could not find container \"5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf\": container with ID starting with 5e78713bb78abc32ec1bc082080b96f695a55379a1f530764a7cfc09026f21bf not found: ID does not exist"
Oct 30 07:38:53.814178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814144    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814294    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814341    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814368    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814414    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814522    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814574 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814565    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814610    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814641    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket\") pod \"03903cb4-dd8c-439d-b855-68127f4b7ad1\" (UID: \"03903cb4-dd8c-439d-b855-68127f4b7ad1\") "
Oct 30 07:38:53.814991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.814958    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:38:53.815210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.815186    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:53.815450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.815422    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:53.815937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.815909    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03903cb4-dd8c-439d-b855-68127f4b7ad1-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.816024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.815939    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.816024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.815953    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.816206 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.816186    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:53.816420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.816396    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:53.818187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.818165    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:38:53.818415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.818393    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:53.819155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.819124    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:38:53.819254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.819146    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r" pod "03903cb4-dd8c-439d-b855-68127f4b7ad1" (UID: "03903cb4-dd8c-439d-b855-68127f4b7ad1"). InnerVolumeSpecName "kube-api-access-c8n7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:38:53.923875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.922104    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8n7r\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-kube-api-access-c8n7r\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.923875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.922148    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.923875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.922163    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.923875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.922178    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.923875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.922191    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03903cb4-dd8c-439d-b855-68127f4b7ad1-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:53.923875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:53.922204    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03903cb4-dd8c-439d-b855-68127f4b7ad1-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:38:54.090396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:54.090360    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"]
Oct 30 07:38:54.094584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:54.094553    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-pbcjc"]
Oct 30 07:38:55.424470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:38:55.424435    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" path="/var/lib/kubelet/pods/03903cb4-dd8c-439d-b855-68127f4b7ad1/volumes"
Oct 30 07:39:13.928379 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:39:13.928329    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:39:19.483093 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:19.483005    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:39:19.483510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:19.483090    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:39:43.332696 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.332663    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"]
Oct 30 07:39:43.333392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.333376    5073 cpu_manager.go:414] "containerMap: removing container" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy"
Oct 30 07:39:43.333438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.333393    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy"
Oct 30 07:39:43.333438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.333420    5073 cpu_manager.go:414] "containerMap: removing container" podUID="1447e674-1452-4b36-9688-0b50766d6a9b" containerName="payload-processing"
Oct 30 07:39:43.333438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.333426    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1447e674-1452-4b36-9688-0b50766d6a9b" containerName="payload-processing"
Oct 30 07:39:43.333541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.333518    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="03903cb4-dd8c-439d-b855-68127f4b7ad1" containerName="istio-proxy"
Oct 30 07:39:43.333541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.333532    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="1447e674-1452-4b36-9688-0b50766d6a9b" containerName="payload-processing"
Oct 30 07:39:43.338654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.338634    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.369541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.369510    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"]
Oct 30 07:39:43.542207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542166    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542233    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542381    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542424    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542519 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542481    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542554    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542624    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542717    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8q6v\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.542774 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.542763    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.643801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.643763    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.643819    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.643918    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.643942    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8q6v\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.643970    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644003    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644034    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644139    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644172    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644278    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644307    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644598 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644518    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644646    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.644714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.644683    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.646410 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.646393    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.646537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.646517    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.666679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.666654    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.666955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.666936    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8q6v\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v\") pod \"maas-default-gateway-openshift-default-6dcf757899-cnvbk\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:43.925685 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:39:43.925586    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:39:43.953866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:43.953823    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:44.281987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.281921    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"]
Oct 30 07:39:44.282453 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:39:44.282418    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b6db11_3fa6_4323_a310_5dc4c6249636.slice/crio-f31edb3eb484bac35272fa07235766f070e1b463129a4540b73c29aab523c194 WatchSource:0}: Error finding container f31edb3eb484bac35272fa07235766f070e1b463129a4540b73c29aab523c194: Status 404 returned error can't find the container with id f31edb3eb484bac35272fa07235766f070e1b463129a4540b73c29aab523c194
Oct 30 07:39:44.285178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.285116    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:39:44.285306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.285227    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:39:44.285306 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.285275    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:39:44.359887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.359824    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" event={"ID":"84b6db11-3fa6-4323-a310-5dc4c6249636","Type":"ContainerStarted","Data":"0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a"}
Oct 30 07:39:44.360212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.359920    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" event={"ID":"84b6db11-3fa6-4323-a310-5dc4c6249636","Type":"ContainerStarted","Data":"f31edb3eb484bac35272fa07235766f070e1b463129a4540b73c29aab523c194"}
Oct 30 07:39:44.411390 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.411326    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podStartSLOduration=1.411307455 podStartE2EDuration="1.411307455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:39:44.407951671 +0000 UTC m=+2587.115831837" watchObservedRunningTime="2026-10-30 07:39:44.411307455 +0000 UTC m=+2587.119187628"
Oct 30 07:39:44.954269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:44.954234    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:45.956033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:45.955999    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:45.956457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:45.956061    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:46.954755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:46.954715    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:46.955001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:46.954775    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:47.954413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:47.954377    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:47.954942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:47.954434    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:48.954470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:48.954435    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:48.954899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:48.954487    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:49.962400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:49.961746    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:49.962400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:49.961812    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:50.954382 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:50.954339    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:50.954685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:50.954642    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:51.986503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:51.985999    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-cnvbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused" start-of-body=
Oct 30 07:39:51.986503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:51.986059    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.165:15021/healthz/ready\": dial tcp 10.132.0.165:15021: connect: connection refused"
Oct 30 07:39:52.003877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.003521    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-78d896675d-98f79"]
Oct 30 07:39:52.040459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.040428    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.051874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.040322    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-78d896675d-98f79"]
Oct 30 07:39:52.143045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.118664    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Oct 30 07:39:52.143045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.118839    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-xmgdm\""
Oct 30 07:39:52.143045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.118933    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-199e3ad5d30e\""
Oct 30 07:39:52.143045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.118996    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Oct 30 07:39:52.143045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.119065    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Oct 30 07:39:52.143045 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.119166    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Oct 30 07:39:52.392177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.392132    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.392403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.392381    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25s6m\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.392458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.392440    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.392593 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.392572    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.493478 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.493431    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25s6m\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.493685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.493521    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.493685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.493590    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.493685 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.493641    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.494666 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.494625    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.494825 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.494753    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.496581 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.496553    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.517495 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.517458    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25s6m\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m\") pod \"payload-processing-external-model-78d896675d-98f79\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") " pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:52.796242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:52.796145    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:53.161801 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.161752    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-78d896675d-98f79"]
Oct 30 07:39:53.261878 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:39:53.261807    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96d2aa4_1ded_47fe_8565_3804abd377b2.slice/crio-bb2b964cbedeea97cf9f486a94c1213a14bd44e3c090c76a0dcd7bf8b4d1cf35 WatchSource:0}: Error finding container bb2b964cbedeea97cf9f486a94c1213a14bd44e3c090c76a0dcd7bf8b4d1cf35: Status 404 returned error can't find the container with id bb2b964cbedeea97cf9f486a94c1213a14bd44e3c090c76a0dcd7bf8b4d1cf35
Oct 30 07:39:53.693568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.693529    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79" event={"ID":"a96d2aa4-1ded-47fe-8565-3804abd377b2","Type":"ContainerStarted","Data":"7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f"}
Oct 30 07:39:53.694674 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.694595    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:39:53.694674 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.694632    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79" event={"ID":"a96d2aa4-1ded-47fe-8565-3804abd377b2","Type":"ContainerStarted","Data":"bb2b964cbedeea97cf9f486a94c1213a14bd44e3c090c76a0dcd7bf8b4d1cf35"}
Oct 30 07:39:53.747561 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.747501    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79" podStartSLOduration=2.74748545 podStartE2EDuration="2.74748545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:39:53.743992101 +0000 UTC m=+2596.451872271" watchObservedRunningTime="2026-10-30 07:39:53.74748545 +0000 UTC m=+2596.455365636"
Oct 30 07:39:53.937533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.937498    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:53.939323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.939205    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:53.940501 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:53.940421    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:39:56.303396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:56.303358    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-78d896675d-98f79"]
Oct 30 07:39:58.376586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.376550    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"]
Oct 30 07:39:58.383274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.383246    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.480795    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.480874    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.480959    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skhr8\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.481099    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.481137    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.481174    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.481287    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.481331    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.482879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.481469    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.513932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.513896    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"]
Oct 30 07:39:58.583391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583357    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583398    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583426    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583496    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583527    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583652 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583634    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583673    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583703    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.583934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583775    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skhr8\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.584116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.583982    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.584396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.584341    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.584396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.584379    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.584691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.584670    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.584823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.584793    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.587342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.587323    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.587690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.587666    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.606573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.606549    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.607624 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.607599    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skhr8\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8\") pod \"maas-default-gateway-openshift-default-6dcf757899-wh8zr\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:58.719000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:58.718916    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:39:59.053198 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:39:59.053167    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3555c316_1c3e_4ed8_9878_6c6185fa17fe.slice/crio-1b7440947a4085c28a215eec5e5d4ad4f5d1ec1c8ade58a8ab124382fd5ef39a WatchSource:0}: Error finding container 1b7440947a4085c28a215eec5e5d4ad4f5d1ec1c8ade58a8ab124382fd5ef39a: Status 404 returned error can't find the container with id 1b7440947a4085c28a215eec5e5d4ad4f5d1ec1c8ade58a8ab124382fd5ef39a
Oct 30 07:39:59.055276 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.055249    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"]
Oct 30 07:39:59.056195 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.056164    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:39:59.056245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.056231    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:39:59.056285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.056270    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:39:59.796788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.796742    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" event={"ID":"3555c316-1c3e-4ed8-9878-6c6185fa17fe","Type":"ContainerStarted","Data":"7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7"}
Oct 30 07:39:59.797370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.796809    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" event={"ID":"3555c316-1c3e-4ed8-9878-6c6185fa17fe","Type":"ContainerStarted","Data":"1b7440947a4085c28a215eec5e5d4ad4f5d1ec1c8ade58a8ab124382fd5ef39a"}
Oct 30 07:39:59.852605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:39:59.852555    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podStartSLOduration=1.852541373 podStartE2EDuration="1.852541373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:39:59.852284555 +0000 UTC m=+2602.560164725" watchObservedRunningTime="2026-10-30 07:39:59.852541373 +0000 UTC m=+2602.560421541"
Oct 30 07:40:00.725787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:00.723917    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:40:00.725787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:00.725603    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:00.725787 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:00.725664    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:01.317906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.313984    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79" podUID="a96d2aa4-1ded-47fe-8565-3804abd377b2" containerName="payload-processing" containerID="cri-o://7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f" gracePeriod=25
Oct 30 07:40:01.666460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.666429    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:40:01.719460 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.719429    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:01.719817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.719482    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:01.751056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.749973    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume\") pod \"a96d2aa4-1ded-47fe-8565-3804abd377b2\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") "
Oct 30 07:40:01.751056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.750151    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials\") pod \"a96d2aa4-1ded-47fe-8565-3804abd377b2\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") "
Oct 30 07:40:01.751056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.750225    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume\") pod \"a96d2aa4-1ded-47fe-8565-3804abd377b2\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") "
Oct 30 07:40:01.751056 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.750327    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m\") pod \"a96d2aa4-1ded-47fe-8565-3804abd377b2\" (UID: \"a96d2aa4-1ded-47fe-8565-3804abd377b2\") "
Oct 30 07:40:01.751370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.751217    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume" pod "a96d2aa4-1ded-47fe-8565-3804abd377b2" (UID: "a96d2aa4-1ded-47fe-8565-3804abd377b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:40:01.751370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.751351    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume" pod "a96d2aa4-1ded-47fe-8565-3804abd377b2" (UID: "a96d2aa4-1ded-47fe-8565-3804abd377b2"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:40:01.753568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.753530    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m" pod "a96d2aa4-1ded-47fe-8565-3804abd377b2" (UID: "a96d2aa4-1ded-47fe-8565-3804abd377b2"). InnerVolumeSpecName "kube-api-access-25s6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:40:01.754174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.754149    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials" pod "a96d2aa4-1ded-47fe-8565-3804abd377b2" (UID: "a96d2aa4-1ded-47fe-8565-3804abd377b2"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:40:01.843297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.843258    5073 generic.go:356] "Generic (PLEG): container finished" podID="a96d2aa4-1ded-47fe-8565-3804abd377b2" containerID="7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f" exitCode=0
Oct 30 07:40:01.843469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.843304    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79"
Oct 30 07:40:01.843469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.843335    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79" event={"ID":"a96d2aa4-1ded-47fe-8565-3804abd377b2","Type":"ContainerDied","Data":"7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f"}
Oct 30 07:40:01.843469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.843386    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-78d896675d-98f79" event={"ID":"a96d2aa4-1ded-47fe-8565-3804abd377b2","Type":"ContainerDied","Data":"bb2b964cbedeea97cf9f486a94c1213a14bd44e3c090c76a0dcd7bf8b4d1cf35"}
Oct 30 07:40:01.843469 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.843411    5073 scope.go:122] "RemoveContainer" containerID="7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f"
Oct 30 07:40:01.851606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.851571    5073 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-provider-credentials\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:01.851606 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.851597    5073 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-routing-overlay-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:01.851805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.851614    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25s6m\" (UniqueName: \"kubernetes.io/projected/a96d2aa4-1ded-47fe-8565-3804abd377b2-kube-api-access-25s6m\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:01.851805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.851630    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a96d2aa4-1ded-47fe-8565-3804abd377b2-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:01.855232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.855206    5073 scope.go:122] "RemoveContainer" containerID="7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f"
Oct 30 07:40:01.855497 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:40:01.855474    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f\": container with ID starting with 7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f not found: ID does not exist" containerID="7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f"
Oct 30 07:40:01.855565 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.855505    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f"} err="failed to get container status \"7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f\": rpc error: code = NotFound desc = could not find container \"7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f\": container with ID starting with 7a1bfc14b2974f029b95e1285acec1472d3f099f6695f296ad3be68ccb3a823f not found: ID does not exist"
Oct 30 07:40:01.917132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.917035    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-78d896675d-98f79"]
Oct 30 07:40:01.923958 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:01.923918    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-78d896675d-98f79"]
Oct 30 07:40:02.740508 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:02.740465    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:02.741739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:02.741700    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:03.423848 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.423812    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a96d2aa4-1ded-47fe-8565-3804abd377b2" path="/var/lib/kubelet/pods/a96d2aa4-1ded-47fe-8565-3804abd377b2/volumes"
Oct 30 07:40:03.585871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.585333    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"]
Oct 30 07:40:03.590905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.586459    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a96d2aa4-1ded-47fe-8565-3804abd377b2" containerName="payload-processing"
Oct 30 07:40:03.590905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.586485    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a96d2aa4-1ded-47fe-8565-3804abd377b2" containerName="payload-processing"
Oct 30 07:40:03.590905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.586731    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a96d2aa4-1ded-47fe-8565-3804abd377b2" containerName="payload-processing"
Oct 30 07:40:03.642415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.636284    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:03.642415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.641995    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"]
Oct 30 07:40:03.656112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.656066    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-8d0c2f\"/\"payload-processing-external-model-plugins-e2e-extmod-a-8d0c2f\""
Oct 30 07:40:03.656262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.656097    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-8d0c2f\"/\"routing-overlay\""
Oct 30 07:40:03.657116 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.657091    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-8d0c2f\"/\"openshift-service-ca.crt\""
Oct 30 07:40:03.657454 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.657436    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-a-8d0c2f\"/\"agc-cred-1f7990b3c7c7\""
Oct 30 07:40:03.667616 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.667584    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-a-8d0c2f\"/\"kube-root-ca.crt\""
Oct 30 07:40:03.667817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.667802    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-a-8d0c2f\"/\"payload-processing-external-model-e2e--d43b6e68-dockercfg-pzntb\""
Oct 30 07:40:03.819935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.807003    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:03.819935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.807109    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:03.854586 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.854541    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf29d\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:03.896491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.896409    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:03.915115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.915036    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:03.915403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:03.915380    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.017309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.017262    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.017529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.017403    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf29d\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.017646 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.017629    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.017720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.017703    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.018207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.018183    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.018459 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.018436    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.022518 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.022493    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.043584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.043548    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf29d\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d\") pod \"payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") " pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.263824 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.263778    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:04.608465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.608365    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"]
Oct 30 07:40:04.613963 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:40:04.613245    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfa9fbd_ff8b_4d23_8312_ad03ad41329e.slice/crio-111fecc7ec6da86dc3bd491dc1efd11c0c8f2e626104320c9a70009438c35eaf WatchSource:0}: Error finding container 111fecc7ec6da86dc3bd491dc1efd11c0c8f2e626104320c9a70009438c35eaf: Status 404 returned error can't find the container with id 111fecc7ec6da86dc3bd491dc1efd11c0c8f2e626104320c9a70009438c35eaf
Oct 30 07:40:04.719371 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.719340    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:04.719505 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.719399    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:04.954447 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.954407    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx" event={"ID":"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e","Type":"ContainerStarted","Data":"fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5"}
Oct 30 07:40:04.954892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.954470    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx" event={"ID":"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e","Type":"ContainerStarted","Data":"111fecc7ec6da86dc3bd491dc1efd11c0c8f2e626104320c9a70009438c35eaf"}
Oct 30 07:40:04.954892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:04.954508    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:05.003328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:05.003255    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx" podStartSLOduration=2.003239636 podStartE2EDuration="2.003239636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:40:05.002337716 +0000 UTC m=+2607.710217896" watchObservedRunningTime="2026-10-30 07:40:05.003239636 +0000 UTC m=+2607.711119829"
Oct 30 07:40:05.719788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:05.719747    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:05.719985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:05.719884    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:06.719889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:06.719818    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused" start-of-body=
Oct 30 07:40:06.720431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:06.719926    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": dial tcp 10.132.0.167:15021: connect: connection refused"
Oct 30 07:40:08.012898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:08.012822    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:40:08.014537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:08.014507    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:40:08.015311 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:08.015290    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:40:13.423625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.423590    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"]
Oct 30 07:40:13.430250 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.430215    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.467277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.467243    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"]
Oct 30 07:40:13.473884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.473515    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.473884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.473722    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.473884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.473801    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.474150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.473934    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.474150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.474031    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.474150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.474095    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9cbv\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.474310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.474190    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.474310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.474214    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.474310 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.474273    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.575739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.575698    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.575739 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.575752    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.575838    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.575929    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9cbv\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576050    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576077    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576102    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576189    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576282    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576290    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576647 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576614    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.576718 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.576677    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.577316 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.577291    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.577665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.577643    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.579121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.579097    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.579430 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.579412    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.598569 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.598544    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9cbv\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.598997 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.598972    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mrg7x\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.750659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:13.750580    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:13.932072 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:40:13.932033    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:40:14.072546 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:40:14.072511    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b699b8c_c8d2_4158_b581_7637e62651dc.slice/crio-3c3e1e97648cbe8a2d37497377e8561ba444664a0d475fc72406be8bae6f263c WatchSource:0}: Error finding container 3c3e1e97648cbe8a2d37497377e8561ba444664a0d475fc72406be8bae6f263c: Status 404 returned error can't find the container with id 3c3e1e97648cbe8a2d37497377e8561ba444664a0d475fc72406be8bae6f263c
Oct 30 07:40:14.074392 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:14.074364    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"]
Oct 30 07:40:14.075378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:14.075347    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:40:14.075443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:14.075414    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:40:14.075479 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:14.075442    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:40:15.098873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.097920    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" event={"ID":"8b699b8c-c8d2-4158-b581-7637e62651dc","Type":"ContainerStarted","Data":"6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80"}
Oct 30 07:40:15.098873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.098001    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" event={"ID":"8b699b8c-c8d2-4158-b581-7637e62651dc","Type":"ContainerStarted","Data":"3c3e1e97648cbe8a2d37497377e8561ba444664a0d475fc72406be8bae6f263c"}
Oct 30 07:40:15.159075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.159015    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podStartSLOduration=2.159000514 podStartE2EDuration="2.159000514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:40:15.155607787 +0000 UTC m=+2617.863487957" watchObservedRunningTime="2026-10-30 07:40:15.159000514 +0000 UTC m=+2617.866880682"
Oct 30 07:40:15.756964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.751198    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:15.756964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.753891    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:15.756964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.753942    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:15.989886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:15.983023    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:40:16.752557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:16.752511    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:16.753133 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:16.752823    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:17.755909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:17.754835    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:17.755909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:17.754955    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:18.757877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:18.752478    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:18.757877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:18.752546    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:19.612876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:19.592146    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:40:19.612876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:19.592214    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:40:19.776881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:19.776367    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:19.776881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:19.776457    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:20.758421 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:20.758381    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:20.758762 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:20.758715    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:21.753754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:21.753267    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:21.753754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:21.753333    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:22.751141 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:22.751104    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused" start-of-body=
Oct 30 07:40:22.751331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:22.751168    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": dial tcp 10.132.0.169:15021: connect: connection refused"
Oct 30 07:40:24.152159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:24.152125    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:24.152590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:24.152576    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:24.153328 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:24.153302    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:40:33.641426 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:33.641391    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"]
Oct 30 07:40:38.656032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:38.655959    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr" podUID="ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" containerName="payload-processing" containerID="cri-o://f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6" gracePeriod=25
Oct 30 07:40:39.058604 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.058570    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:40:39.292627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.290845    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx\") pod \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") "
Oct 30 07:40:39.292627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.290970    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume\") pod \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") "
Oct 30 07:40:39.292627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.291158    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume\") pod \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") "
Oct 30 07:40:39.292627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.291239    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials\") pod \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\" (UID: \"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de\") "
Oct 30 07:40:39.304019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.300169    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume" pod "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" (UID: "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:40:39.304019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.300713    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume" pod "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" (UID: "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:40:39.318761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.318733    5073 generic.go:356] "Generic (PLEG): container finished" podID="ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" containerID="f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6" exitCode=0
Oct 30 07:40:39.319262 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.318909    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr" event={"ID":"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de","Type":"ContainerDied","Data":"f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6"}
Oct 30 07:40:39.319564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.319072    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"
Oct 30 07:40:39.319709 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.319653    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr" event={"ID":"ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de","Type":"ContainerDied","Data":"a94ce91281d7c8d569289ef128a5604f8127d4a4de03c933d73b0a11bde3763f"}
Oct 30 07:40:39.319819 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.319669    5073 scope.go:122] "RemoveContainer" containerID="f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6"
Oct 30 07:40:39.320819 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.320791    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials" pod "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" (UID: "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:40:39.321798 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.321774    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx" pod "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" (UID: "ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de"). InnerVolumeSpecName "kube-api-access-hpzrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:40:39.350104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.350078    5073 scope.go:122] "RemoveContainer" containerID="f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6"
Oct 30 07:40:39.350465 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:40:39.350437    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6\": container with ID starting with f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6 not found: ID does not exist" containerID="f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6"
Oct 30 07:40:39.350544 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.350477    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6"} err="failed to get container status \"f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6\": rpc error: code = NotFound desc = could not find container \"f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6\": container with ID starting with f4a55ffc2858b335c6957331ae90dac018b99e7e72f2fd804dfa33709bb208d6 not found: ID does not exist"
Oct 30 07:40:39.393579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.393548    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpzrx\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-kube-api-access-hpzrx\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:39.393579 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.393578    5073 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-routing-overlay-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:39.393737 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.393592    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:39.393737 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.393604    5073 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de-provider-credentials\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:40:39.660595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.660560    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"]
Oct 30 07:40:39.672891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:39.672820    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-a-0f5081/payload-processing-external-model-e2e-extmod-a-0f5081-6b66kv5mr"]
Oct 30 07:40:41.522564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:41.522142    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" path="/var/lib/kubelet/pods/ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de/volumes"
Oct 30 07:40:43.955129 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:40:43.955093    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:40:52.943099 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:52.942895    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"]
Oct 30 07:40:52.944269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:52.943905    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" containerName="payload-processing"
Oct 30 07:40:52.944269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:52.943948    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" containerName="payload-processing"
Oct 30 07:40:52.944269 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:52.944196    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac8acd9c-cb1a-40a8-b9c0-b8a6a1fec9de" containerName="payload-processing"
Oct 30 07:40:52.950443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:52.950419    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:52.986689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:52.986660    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ad434e-openshift-default-dockercfg-ctm2x\""
Oct 30 07:40:53.000639 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.000606    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"]
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082317    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vmwl\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082393    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082434    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082568    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082597    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082633    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082692    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082793    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.094877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.082833    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.227355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.227262    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.228224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.228199    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.229743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.228142    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.229970 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.229681    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.237301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.230487    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.248073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.248043    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.248451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.248429    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.259921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.249465    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.259921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.259007    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.259921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.259213    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vmwl\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.259921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.259256    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.259921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.259295    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.260304 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.260025    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.261315 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.260756    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.263074 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.262797    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.280658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.278034    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.298194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.293373    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.298194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.298056    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vmwl\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl\") pod \"e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") " pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.569150 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.569057    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:53.895636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.895601    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"]
Oct 30 07:40:53.895992 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:40:53.895963    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0191355_f7d6_4d43_913a_976a9c45b2a3.slice/crio-e76529d46037c3b19d415a8dd8901e7a72f915234af95777772107c7c5aa882c WatchSource:0}: Error finding container e76529d46037c3b19d415a8dd8901e7a72f915234af95777772107c7c5aa882c: Status 404 returned error can't find the container with id e76529d46037c3b19d415a8dd8901e7a72f915234af95777772107c7c5aa882c
Oct 30 07:40:53.898932 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.898896    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:40:53.899029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.898964    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:40:53.899029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:53.898993    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:40:54.580129 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:54.580091    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" event={"ID":"d0191355-f7d6-4d43-913a-976a9c45b2a3","Type":"ContainerStarted","Data":"f2c05a2cbfc0d6eb0fd2911721931bc57c93ca7b66086e9f89cea6eea4ddf45f"}
Oct 30 07:40:54.580573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:54.580152    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" event={"ID":"d0191355-f7d6-4d43-913a-976a9c45b2a3","Type":"ContainerStarted","Data":"e76529d46037c3b19d415a8dd8901e7a72f915234af95777772107c7c5aa882c"}
Oct 30 07:40:54.637232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:54.637176    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podStartSLOduration=2.637162812 podStartE2EDuration="2.637162812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:40:54.636541083 +0000 UTC m=+2657.344421249" watchObservedRunningTime="2026-10-30 07:40:54.637162812 +0000 UTC m=+2657.345042981"
Oct 30 07:40:55.569562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:55.569511    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:55.581665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:55.581633    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:55.627363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:55.627332    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:55.629545 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:55.629522    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:40:58.990877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:58.989918    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"]
Oct 30 07:40:59.244923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.230084    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"]
Oct 30 07:40:59.270017 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.241412    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.298939    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299001    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299072    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299136    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299176    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299215    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6qc2\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299366    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299396    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.299423    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.333993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.300807    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-a8f1df-openshift-default-dockercfg-9q6vn\""
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.434946    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435009    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435078    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435147    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435185    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435221    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6qc2\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435377    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435403    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.435429    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.438869 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.436788    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.444874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.441254    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.444874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.441536    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.473877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.447057    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.492875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.475120    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.642936 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.622621    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:40:59.689941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.633361    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 07:40:59.862490 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.862458    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6qc2\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.866711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.866341    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:40:59.911687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:40:59.911604    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:00.043915 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:00.035100    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token\") pod \"e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") " pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:00.070217 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:00.064623    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:00.194503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:00.194001    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:41:01.145438 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:41:01.145403    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f1aa75_34b6_47b8_819a_432113cdd7e4.slice/crio-b92a9e8b767781af23938e7b25b57f4ab97bda7985c0bce44ab0991ff48a41f5 WatchSource:0}: Error finding container b92a9e8b767781af23938e7b25b57f4ab97bda7985c0bce44ab0991ff48a41f5: Status 404 returned error can't find the container with id b92a9e8b767781af23938e7b25b57f4ab97bda7985c0bce44ab0991ff48a41f5
Oct 30 07:41:01.145898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.145739    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"]
Oct 30 07:41:01.148751 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.148713    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:01.148880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.148798    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:01.148880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.148845    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:01.628115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.628075    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"]
Oct 30 07:41:01.633097 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.633061    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.655312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.655278    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"]
Oct 30 07:41:01.659756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.659727    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-8d0c2f-openshift-default-dockercfg-w2dlv\""
Oct 30 07:41:01.747002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.746957    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747142    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747173    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747237    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747332    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747393    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj645\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747436    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747466    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.747591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.747560    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849219 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849177    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849242    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj645\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849283    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849307    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849385    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849462    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849548    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849584    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849690 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849652    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849814    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.849941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.849905    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.850166 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.850143    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.850239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.850189    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.850491 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.850465    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.852186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.852150    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.852297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.852238    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.872060 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.872027    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.872224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.872193    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj645\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645\") pod \"e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") " pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:01.952125 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:01.952012    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:02.071313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.070500    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" event={"ID":"83f1aa75-34b6-47b8-819a-432113cdd7e4","Type":"ContainerStarted","Data":"a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458"}
Oct 30 07:41:02.071313 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.070559    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" event={"ID":"83f1aa75-34b6-47b8-819a-432113cdd7e4","Type":"ContainerStarted","Data":"b92a9e8b767781af23938e7b25b57f4ab97bda7985c0bce44ab0991ff48a41f5"}
Oct 30 07:41:02.157404 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.157371    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:02.159394 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.159361    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused" start-of-body=
Oct 30 07:41:02.159608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.159580    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused"
Oct 30 07:41:02.413503 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.413062    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podStartSLOduration=4.413036237 podStartE2EDuration="4.413036237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:41:02.133946202 +0000 UTC m=+2664.841826372" watchObservedRunningTime="2026-10-30 07:41:02.413036237 +0000 UTC m=+2665.120916407"
Oct 30 07:41:02.413679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.413654    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"]
Oct 30 07:41:02.415771 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:41:02.415742    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d444b8a_2478_4417_9cc9_be7f4a4d242c.slice/crio-37fe234a5beef8077557e3c3c85956558d5ea0a6f0b5f2c2c02160166d195788 WatchSource:0}: Error finding container 37fe234a5beef8077557e3c3c85956558d5ea0a6f0b5f2c2c02160166d195788: Status 404 returned error can't find the container with id 37fe234a5beef8077557e3c3c85956558d5ea0a6f0b5f2c2c02160166d195788
Oct 30 07:41:02.425163 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.425127    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:02.425375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.425357    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:02.425484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:02.425472    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:03.052933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.052889    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"]
Oct 30 07:41:03.057672 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.057645    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.090448 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.090411    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-8e7948-openshift-default-dockercfg-zbjgh\""
Oct 30 07:41:03.114132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.114094    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"]
Oct 30 07:41:03.121979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.121710    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.121979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.121795    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.121979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.121978    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.122286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.122005    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.122286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.122084    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.122286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.122134    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.122286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.122248    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2llk8\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.122492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.122372    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.122492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.122472    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.131736 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.131694    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" event={"ID":"1d444b8a-2478-4417-9cc9-be7f4a4d242c","Type":"ContainerStarted","Data":"b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2"}
Oct 30 07:41:03.131921 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.131758    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" event={"ID":"1d444b8a-2478-4417-9cc9-be7f4a4d242c","Type":"ContainerStarted","Data":"37fe234a5beef8077557e3c3c85956558d5ea0a6f0b5f2c2c02160166d195788"}
Oct 30 07:41:03.148118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.148082    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused" start-of-body=
Oct 30 07:41:03.148411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.148383    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused"
Oct 30 07:41:03.223444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223399    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.223444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223446    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223493    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223514    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223554    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223589    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223685    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2llk8\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223754    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.223828    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.224688 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.224665    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.225191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.225166    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.225711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.225679    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.225803 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.225726    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.226221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.226198    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.227777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.227748    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.229161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.229139    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.247798 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.247772    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.248658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.248638    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2llk8\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8\") pod \"e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") " pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.399885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.399376    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:03.748714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.748652    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podStartSLOduration=2.748629403 podStartE2EDuration="2.748629403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:41:03.21041313 +0000 UTC m=+2665.918293299" watchObservedRunningTime="2026-10-30 07:41:03.748629403 +0000 UTC m=+2666.456509576"
Oct 30 07:41:03.751057 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:41:03.751026    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda556e2c8_011b_4004_a3d5_bdb09e88145f.slice/crio-22f077ed0db0d8aa4c56c74542944ee4f9c1f7dc02c7333496bed23f4a440004 WatchSource:0}: Error finding container 22f077ed0db0d8aa4c56c74542944ee4f9c1f7dc02c7333496bed23f4a440004: Status 404 returned error can't find the container with id 22f077ed0db0d8aa4c56c74542944ee4f9c1f7dc02c7333496bed23f4a440004
Oct 30 07:41:03.751194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.751089    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"]
Oct 30 07:41:03.754263 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.754231    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:03.754323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.754299    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:03.754362 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.754331    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:03.950321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.950286    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"]
Oct 30 07:41:03.955095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.954938    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:03.955095 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.954982    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:03.957063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.956942    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:03.957187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.957034    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:03.963473 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.963446    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"]
Oct 30 07:41:03.974878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:03.971841    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-932c00-openshift-default-dockercfg-bdh8l\""
Oct 30 07:41:04.104930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.090797    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.104930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.090906    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.104930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.091000    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.104930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.091045    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.104930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.091187    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.104930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.091227    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.153938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.148242    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused" start-of-body=
Oct 30 07:41:04.153938 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.148309    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused"
Oct 30 07:41:04.249954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.249895    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.249954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.249954    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250084    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250125    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250313    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250345    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250391    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9dkv\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250447    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.250769 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.250509    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.251242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.251049    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.251776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.251747    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.252914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.252380    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.252914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.252614    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.255203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.255150    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.256629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.256465    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" event={"ID":"a556e2c8-011b-4004-a3d5-bdb09e88145f","Type":"ContainerStarted","Data":"6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0"}
Oct 30 07:41:04.256629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.256494    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.256629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.256518    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" event={"ID":"a556e2c8-011b-4004-a3d5-bdb09e88145f","Type":"ContainerStarted","Data":"22f077ed0db0d8aa4c56c74542944ee4f9c1f7dc02c7333496bed23f4a440004"}
Oct 30 07:41:04.352151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.351782    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.352151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.351836    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.352151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.351891    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9dkv\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.355241 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.353422    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.380327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.380222    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.382280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.382224    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9dkv\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv\") pod \"e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") " pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.413625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.404430    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:04.413625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.404552    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:04.413625 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.404596    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:04.662292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.661691    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:04.962929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.955212    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:04.962929 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:04.955275    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:05.158372 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.158331    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused" start-of-body=
Oct 30 07:41:05.158583 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.158395    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused"
Oct 30 07:41:05.629877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.572214    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:05.629877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.572272    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:05.638318 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.638254    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podStartSLOduration=2.638233454 podStartE2EDuration="2.638233454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:41:04.321182602 +0000 UTC m=+2667.029062774" watchObservedRunningTime="2026-10-30 07:41:05.638233454 +0000 UTC m=+2668.346113624"
Oct 30 07:41:05.983353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.983279    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:06.003910 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:05.983728    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:06.132875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.117268    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:41:06.132875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.008142    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:06.132875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.118394    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:06.196035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.195938    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused" start-of-body=
Oct 30 07:41:06.249181 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.249117    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused"
Oct 30 07:41:06.270733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.269792    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"]
Oct 30 07:41:06.411348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.411309    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:06.411667 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.411621    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:06.639926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.610663    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" event={"ID":"023336e5-6920-46d1-974f-263eb4e8b00b","Type":"ContainerStarted","Data":"ffb01b9597ecef29af47c784770dff85df1802b38d7c399208a0797fafd8dabd"}
Oct 30 07:41:06.967937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.962649    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:06.967937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:06.962710    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:07.192955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.176231    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused" start-of-body=
Oct 30 07:41:07.192955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.176293    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.171:15021/healthz/ready\": dial tcp 10.132.0.171:15021: connect: connection refused"
Oct 30 07:41:07.407600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.407154    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:07.407600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.407217    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:07.823331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.823289    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" event={"ID":"023336e5-6920-46d1-974f-263eb4e8b00b","Type":"ContainerStarted","Data":"8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab"}
Oct 30 07:41:07.957885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.957198    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:07.957885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:07.957262    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:08.152977 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.152945    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:08.153629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.153570    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:08.154393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.154373    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:41:08.232919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.228072    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podStartSLOduration=5.22805248 podStartE2EDuration="5.22805248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:41:07.860279563 +0000 UTC m=+2670.568159732" watchObservedRunningTime="2026-10-30 07:41:08.22805248 +0000 UTC m=+2670.935932651"
Oct 30 07:41:08.417068 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.416965    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:08.424879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.417292    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:08.664161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.664082    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:08.665868 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.665823    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused" start-of-body=
Oct 30 07:41:08.666118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.666088    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused"
Oct 30 07:41:08.975192 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:08.975150    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:09.005002 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.004949    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:09.409450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.408272    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:09.409450 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.408346    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:09.669959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.665974    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused" start-of-body=
Oct 30 07:41:09.669959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.666036    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused"
Oct 30 07:41:09.953211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.953123    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused" start-of-body=
Oct 30 07:41:09.953211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:09.953181    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.172:15021/healthz/ready\": dial tcp 10.132.0.172:15021: connect: connection refused"
Oct 30 07:41:10.424877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.417834    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:10.424877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.417910    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:10.662776 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.662745    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused" start-of-body=
Oct 30 07:41:10.663018 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.662996    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused"
Oct 30 07:41:10.958659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.958628    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:10.959664 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.959631    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:10.960682 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:10.960665    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 07:41:11.401303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:11.401264    5073 patch_prober.go:29] interesting pod/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused" start-of-body=
Oct 30 07:41:11.401571 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:11.401537    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.173:15021/healthz/ready\": dial tcp 10.132.0.173:15021: connect: connection refused"
Oct 30 07:41:11.662835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:11.662734    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused" start-of-body=
Oct 30 07:41:11.662835 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:11.662807    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused"
Oct 30 07:41:12.410443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:12.410402    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:12.410993 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:12.410948    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:12.412168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:12.412147    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:41:12.664926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:12.663377    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused" start-of-body=
Oct 30 07:41:12.664926 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:12.663445    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused"
Oct 30 07:41:13.662691 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:13.662653    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused" start-of-body=
Oct 30 07:41:13.662920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:13.662719    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.174:15021/healthz/ready\": dial tcp 10.132.0.174:15021: connect: connection refused"
Oct 30 07:41:13.929845 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:41:13.929761    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:41:14.667420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:14.667385    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:14.667813 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:14.667788    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:14.668557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:14.668534    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:41:37.998275 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:41:37.989917    5073 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f1aa75_34b6_47b8_819a_432113cdd7e4.slice/crio-b92a9e8b767781af23938e7b25b57f4ab97bda7985c0bce44ab0991ff48a41f5\": RecentStats: unable to find data in memory cache]"
Oct 30 07:41:38.966928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:38.966206    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:41:39.034874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:39.031116    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:41:39.073875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:39.071939    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-wh8zr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.167:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:41:39.073875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:41:39.072012    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.167:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:41:43.926485 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:41:43.926444    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:42:13.923982 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:42:13.923939    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:42:25.199930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:25.199128    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mrg7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.169:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:42:25.199930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:25.199298    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.169:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:42:25.463946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:25.460391    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:42:25.553986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:25.553935    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:42:26.111877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:26.099054    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:42:36.472920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:36.472881    5073 generic.go:356] "Generic (PLEG): container finished" podID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerID="f2c05a2cbfc0d6eb0fd2911721931bc57c93ca7b66086e9f89cea6eea4ddf45f" exitCode=0
Oct 30 07:42:36.473428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:36.472923    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" event={"ID":"d0191355-f7d6-4d43-913a-976a9c45b2a3","Type":"ContainerDied","Data":"f2c05a2cbfc0d6eb0fd2911721931bc57c93ca7b66086e9f89cea6eea4ddf45f"}
Oct 30 07:42:36.473428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:36.473323    5073 scope.go:122] "RemoveContainer" containerID="f2c05a2cbfc0d6eb0fd2911721931bc57c93ca7b66086e9f89cea6eea4ddf45f"
Oct 30 07:42:36.475242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:36.475212    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:42:36.475352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:36.475287    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:42:36.475352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:36.475321    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:42:37.505536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:37.505492    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" event={"ID":"d0191355-f7d6-4d43-913a-976a9c45b2a3","Type":"ContainerStarted","Data":"a9f9b82a0223c278da7580c17d231837b0766c7440f7f7674b6a7deaaf8478f5"}
Oct 30 07:42:37.585877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:37.570761    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:42:37.585877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:37.577960    5073 patch_prober.go:29] interesting pod/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused" start-of-body=
Oct 30 07:42:37.585877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:37.578026    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused"
Oct 30 07:42:38.570128 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:38.570096    5073 patch_prober.go:29] interesting pod/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused" start-of-body=
Oct 30 07:42:38.570512 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:38.570143    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused"
Oct 30 07:42:39.570189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:39.570152    5073 patch_prober.go:29] interesting pod/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused" start-of-body=
Oct 30 07:42:39.570576 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:39.570208    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused"
Oct 30 07:42:40.614870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:40.613896    5073 patch_prober.go:29] interesting pod/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused" start-of-body=
Oct 30 07:42:40.614870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:40.613971    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused"
Oct 30 07:42:40.640875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:40.640211    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:42:41.570158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.570124    5073 patch_prober.go:29] interesting pod/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused" start-of-body=
Oct 30 07:42:41.570367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.570181    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused"
Oct 30 07:42:41.728872 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.728388    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"]
Oct 30 07:42:41.735890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.734059    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.760517 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.760237    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8fef73-openshift-default-dockercfg-dsd9s\""
Oct 30 07:42:41.771012 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.770987    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"]
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939012    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939112    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939234    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939262    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939294    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939325    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939375    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvsm\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939422    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:41.939877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:41.939472    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.075383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.075343    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.075680 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.075657    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.075914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.075763    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.081146 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.076395    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.081631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.075842    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.081991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.081965    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.084090 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.082814    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvsm\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.085029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.085006    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.086253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.086234    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.087019 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.086999    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.089069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.089050    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.089922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.088920    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.090076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.086027    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.090192 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.089432    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.118177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.118107    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.159278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.128948    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.159278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.144208    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.159278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.153842    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvsm\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm\") pod \"e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") " pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.351118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.351024    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:42.570540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.570120    5073 patch_prober.go:29] interesting pod/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused" start-of-body=
Oct 30 07:42:42.570540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.570184    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.170:15021/healthz/ready\": dial tcp 10.132.0.170:15021: connect: connection refused"
Oct 30 07:42:42.715131 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:42:42.715098    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b33aa17_9248_442b_93c9_6ec92a35ec01.slice/crio-3934b87d6d787333e12f26b7ea39cde0b3a48a6f389957a5fd4e43c26ef2c81d WatchSource:0}: Error finding container 3934b87d6d787333e12f26b7ea39cde0b3a48a6f389957a5fd4e43c26ef2c81d: Status 404 returned error can't find the container with id 3934b87d6d787333e12f26b7ea39cde0b3a48a6f389957a5fd4e43c26ef2c81d
Oct 30 07:42:42.717442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.717417    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"]
Oct 30 07:42:42.718494 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.718466    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:42:42.718556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.718529    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:42:42.718591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:42.718559    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:42:43.641259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:43.641221    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" event={"ID":"4b33aa17-9248-442b-93c9-6ec92a35ec01","Type":"ContainerStarted","Data":"73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"}
Oct 30 07:42:43.641660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:43.641278    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" event={"ID":"4b33aa17-9248-442b-93c9-6ec92a35ec01","Type":"ContainerStarted","Data":"3934b87d6d787333e12f26b7ea39cde0b3a48a6f389957a5fd4e43c26ef2c81d"}
Oct 30 07:42:43.699117 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:43.699061    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podStartSLOduration=2.699048219 podStartE2EDuration="2.699048219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:42:43.695733798 +0000 UTC m=+2766.403613968" watchObservedRunningTime="2026-10-30 07:42:43.699048219 +0000 UTC m=+2766.406928387"
Oct 30 07:42:43.794870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:43.794817    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:42:43.796022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:43.795997    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:42:43.927502 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:42:43.927422    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:42:44.351946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:44.351868    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:44.359069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:44.359044    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:44.652962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:44.652927    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:42:44.653953 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:42:44.653932    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:43:03.463873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:03.463777    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:43:04.159901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.131959    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 30 07:43:04.468978 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.468007    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:43:04.469725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.469694    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:43:04.514883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.514448    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-6v6gx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:43:04.514883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.514548    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-6v6gx" podUID="f0f75d92-2523-4dbe-89d0-628ebd8c8690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:43:04.559875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.551949    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:43:04.796636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:04.796542    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 07:43:13.926945 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:43:13.926907    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:43:37.935832 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:37.935799    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"]
Oct 30 07:43:37.940626 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:37.940595    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:37.963621 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:37.963593    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-8fef73-serving-cert\""
Oct 30 07:43:37.970406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:37.970377    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"]
Oct 30 07:43:38.064822 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.064785    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.065035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.064958    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.065158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.065141    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.065283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.065263    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkc2k\" (UniqueName: \"kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.166354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.166321    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.166526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.166452    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.166526 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.166521    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkc2k\" (UniqueName: \"kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.166644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.166633    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.167160 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.167129    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.168841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.168809    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.168990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.168977    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.217312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.217177    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkc2k\" (UniqueName: \"kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k\") pod \"maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.261051 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.260658    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:38.601571 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:43:38.601542    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c2ebbb_2d28_413d_9f48_ea7164c7fb08.slice/crio-327d7b93fe235046bd169c14d0c47c9f7193201aa5f9aef4d4b62be3c7225f36 WatchSource:0}: Error finding container 327d7b93fe235046bd169c14d0c47c9f7193201aa5f9aef4d4b62be3c7225f36: Status 404 returned error can't find the container with id 327d7b93fe235046bd169c14d0c47c9f7193201aa5f9aef4d4b62be3c7225f36
Oct 30 07:43:38.603434 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.603411    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"]
Oct 30 07:43:38.603533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:38.603479    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:43:39.531756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:39.531713    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns" event={"ID":"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08","Type":"ContainerStarted","Data":"e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5"}
Oct 30 07:43:39.532208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:39.531785    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns" event={"ID":"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08","Type":"ContainerStarted","Data":"327d7b93fe235046bd169c14d0c47c9f7193201aa5f9aef4d4b62be3c7225f36"}
Oct 30 07:43:39.532208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:39.531814    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:43:39.574145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:39.574094    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns" podStartSLOduration=2.113067686 podStartE2EDuration="2.574077255s" totalImagesPullingTime="461.009569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:43:39.572516398 +0000 UTC m=+2822.280396566" watchObservedRunningTime="2026-10-30 07:43:39.574077255 +0000 UTC m=+2822.281957465"
Oct 30 07:43:43.924919 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:43:43.924881    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:43:45.545755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:43:45.545721    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:44:13.979359 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:44:13.979272    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:44:20.974415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:20.974375    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"]
Oct 30 07:44:25.975352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:25.975287    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx" podUID="2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" containerName="payload-processing" containerID="cri-o://fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5" gracePeriod=25
Oct 30 07:44:26.282268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.282240    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:44:26.355956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.355924    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume\") pod \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") "
Oct 30 07:44:26.356151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356001    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials\") pod \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") "
Oct 30 07:44:26.356151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356050    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d\") pod \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") "
Oct 30 07:44:26.356151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356111    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume\") pod \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\" (UID: \"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e\") "
Oct 30 07:44:26.356528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356500    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume" pod "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" (UID: "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:44:26.356592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356540    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume" pod "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" (UID: "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:44:26.356741 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356725    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:44:26.356793 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.356744    5073 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-routing-overlay-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:44:26.359016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.358986    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials" pod "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" (UID: "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:44:26.359131 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.359033    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d" pod "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" (UID: "2bfa9fbd-ff8b-4d23-8312-ad03ad41329e"). InnerVolumeSpecName "kube-api-access-wf29d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:44:26.458522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.458486    5073 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-provider-credentials\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:44:26.458522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.458512    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf29d\" (UniqueName: \"kubernetes.io/projected/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e-kube-api-access-wf29d\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:44:26.998759 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.998719    5073 generic.go:356] "Generic (PLEG): container finished" podID="2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" containerID="fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5" exitCode=0
Oct 30 07:44:26.999188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.998972    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx" event={"ID":"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e","Type":"ContainerDied","Data":"fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5"}
Oct 30 07:44:26.999188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.999058    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx" event={"ID":"2bfa9fbd-ff8b-4d23-8312-ad03ad41329e","Type":"ContainerDied","Data":"111fecc7ec6da86dc3bd491dc1efd11c0c8f2e626104320c9a70009438c35eaf"}
Oct 30 07:44:26.999188 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.999088    5073 scope.go:122] "RemoveContainer" containerID="fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5"
Oct 30 07:44:26.999346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:26.999253    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"
Oct 30 07:44:27.018467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:27.017292    5073 scope.go:122] "RemoveContainer" containerID="fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5"
Oct 30 07:44:27.018467 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:44:27.017657    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5\": container with ID starting with fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5 not found: ID does not exist" containerID="fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5"
Oct 30 07:44:27.018467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:27.017694    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5"} err="failed to get container status \"fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5\": rpc error: code = NotFound desc = could not find container \"fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5\": container with ID starting with fd332908b27e6fcc15f629f478ca8ddb7dfcd755227ab36a2c2404c0c2796ca5 not found: ID does not exist"
Oct 30 07:44:27.062802 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:27.062768    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"]
Oct 30 07:44:27.074064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:27.074037    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-a-8d0c2f/payload-processing-external-model-e2e-extmod-a-8d0c2f-7b88fzvwx"]
Oct 30 07:44:27.447635 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:27.447589    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" path="/var/lib/kubelet/pods/2bfa9fbd-ff8b-4d23-8312-ad03ad41329e/volumes"
Oct 30 07:44:36.692149 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.692110    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"]
Oct 30 07:44:36.693940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.693911    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" containerName="payload-processing"
Oct 30 07:44:36.694113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.694096    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" containerName="payload-processing"
Oct 30 07:44:36.694420 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.694401    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bfa9fbd-ff8b-4d23-8312-ad03ad41329e" containerName="payload-processing"
Oct 30 07:44:36.699103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.699077    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.713055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.713031    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"]
Oct 30 07:44:36.754164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.754138    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-91c8c2-openshift-default-dockercfg-hmtrv\""
Oct 30 07:44:36.859431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859393    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859452    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859546    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859575    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859694 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859681    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859770    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859830    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk4w5\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859928    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.859981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.859956    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966417    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966518    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4w5\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966565    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966619    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966694    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966756    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966798    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.966924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966833    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.967482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.966992    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.971871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.967595    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.971871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.967908    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.971871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.968892    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.971871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.969183    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:36.971871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:36.971561    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:37.075893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.075772    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4w5\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:37.109990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.098436    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:37.109990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.099391    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:37.129898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.110673    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy\") pod \"e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") " pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:37.163611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.163328    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:37.728916 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:44:37.728887    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb856fb82_455b_4e05_b77e_e1a061545b4e.slice/crio-4d575adb83bfa7470a58391ebc4ac48c39b1d59bf35fd4b1dc3362cdd4a79be6 WatchSource:0}: Error finding container 4d575adb83bfa7470a58391ebc4ac48c39b1d59bf35fd4b1dc3362cdd4a79be6: Status 404 returned error can't find the container with id 4d575adb83bfa7470a58391ebc4ac48c39b1d59bf35fd4b1dc3362cdd4a79be6
Oct 30 07:44:37.730557 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.730506    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"]
Oct 30 07:44:37.731841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.731805    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:44:37.731950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.731897    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:44:37.731950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:37.731928    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:44:38.259427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:38.259393    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" event={"ID":"b856fb82-455b-4e05-b77e-e1a061545b4e","Type":"ContainerStarted","Data":"2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"}
Oct 30 07:44:38.259668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:38.259444    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" event={"ID":"b856fb82-455b-4e05-b77e-e1a061545b4e","Type":"ContainerStarted","Data":"4d575adb83bfa7470a58391ebc4ac48c39b1d59bf35fd4b1dc3362cdd4a79be6"}
Oct 30 07:44:38.320723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:38.320671    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podStartSLOduration=2.320658908 podStartE2EDuration="2.320658908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:44:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:44:38.317503036 +0000 UTC m=+2881.025383217" watchObservedRunningTime="2026-10-30 07:44:38.320658908 +0000 UTC m=+2881.028539077"
Oct 30 07:44:39.164001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:39.163968    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:39.170092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:39.170068    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:39.266745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:39.266703    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:39.267719 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:39.267697    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:44:44.288887 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:44:44.288820    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:44:44.871877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:44.856470    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:44:45.118990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:45.118938    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:44:45.717147 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:45.717100    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:44:45.717661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:45.717177    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:44:55.952634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:55.952600    5073 generic.go:356] "Generic (PLEG): container finished" podID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerID="73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494" exitCode=0
Oct 30 07:44:55.953143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:55.952644    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" event={"ID":"4b33aa17-9248-442b-93c9-6ec92a35ec01","Type":"ContainerDied","Data":"73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"}
Oct 30 07:44:55.953143 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:55.953042    5073 scope.go:122] "RemoveContainer" containerID="73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"
Oct 30 07:44:55.954940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:55.954903    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:44:55.955040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:55.954981    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:44:55.955040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:55.955014    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:44:56.962413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:56.962360    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" event={"ID":"4b33aa17-9248-442b-93c9-6ec92a35ec01","Type":"ContainerStarted","Data":"fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89"}
Oct 30 07:44:57.351293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:57.351197    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:44:57.352346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:57.352319    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 07:44:57.352480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:57.352377    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 07:44:58.352203 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:58.352165    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 07:44:58.352600 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:58.352220    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 07:44:59.351533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:59.351488    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 07:44:59.351748 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:59.351558    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 07:44:59.653578 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:44:59.653542    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:45:00.363948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.363909    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 07:45:00.365980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.365931    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 07:45:00.387689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.387656    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"]
Oct 30 07:45:00.436168 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.436136    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"]
Oct 30 07:45:00.441069 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.441001    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.442693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.442670    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"]
Oct 30 07:45:00.442828 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.442742    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.465230 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.465201    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"]
Oct 30 07:45:00.466196 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.466171    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9pb7\""
Oct 30 07:45:00.469404 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.469377    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"]
Oct 30 07:45:00.507982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.507958    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.518023 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.511910    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"]
Oct 30 07:45:00.519092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.519068    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"]
Oct 30 07:45:00.521389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.521365    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.531280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.531253    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf2m8\" (UniqueName: \"kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8\") pod \"maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.531455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.531441    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68zw2\" (UniqueName: \"kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.531614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.531603    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.531720 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.531711    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.546031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.545984    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.546334 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.545816    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"]
Oct 30 07:45:00.546546 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.546529    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"]
Oct 30 07:45:00.552891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.550249    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"]
Oct 30 07:45:00.632905 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.632874    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68zw2\" (UniqueName: \"kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.633073 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.632954    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.633134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633114    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.633179 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633151    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8dg4\" (UniqueName: \"kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.633226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633186    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.633386 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633361    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.633493 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633479    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.633541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633523    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d76gs\" (UniqueName: \"kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs\") pod \"maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.633588 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633575    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf2m8\" (UniqueName: \"kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8\") pod \"maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.633644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633623    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6lcc\" (UniqueName: \"kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc\") pod \"maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.633864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633830    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.634004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.633985    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.658616 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.658581    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf2m8\" (UniqueName: \"kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8\") pod \"maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.659060 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.658636    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68zw2\" (UniqueName: \"kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.735363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.735319    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dg4\" (UniqueName: \"kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.735363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.735363    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.735618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.735477    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.735618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.735511    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d76gs\" (UniqueName: \"kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs\") pod \"maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.735618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.735556    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6lcc\" (UniqueName: \"kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc\") pod \"maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.735618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.735602    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.736205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.736178    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.736323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.736237    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.736323 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.736271    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.758548 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.758518    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d76gs\" (UniqueName: \"kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs\") pod \"maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.759209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.759188    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8dg4\" (UniqueName: \"kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.761750 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.761730    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6lcc\" (UniqueName: \"kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc\") pod \"maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:00.768960 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.768936    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:00.830637 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.830607    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:00.854364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.854332    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:00.904226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.904054    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:00.911057 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:00.908972    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:01.315204 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.314844    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"]
Oct 30 07:45:01.315694 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:45:01.315666    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a8ae33_21ed_462a_bfc4_816e7395dd64.slice/crio-fbb3e2adf3cbd3e6e21f7e933ff941c4ff45fc961170a8ee2f01bc05a44936e8 WatchSource:0}: Error finding container fbb3e2adf3cbd3e6e21f7e933ff941c4ff45fc961170a8ee2f01bc05a44936e8: Status 404 returned error can't find the container with id fbb3e2adf3cbd3e6e21f7e933ff941c4ff45fc961170a8ee2f01bc05a44936e8
Oct 30 07:45:01.347885 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:45:01.346684    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecfdbc3_6a20_4aba_a3a9_822240aa4814.slice/crio-fbb8b2400ccb62e0561e3fd7ec21c00e5e49d6e391ade98422e7a8afc701d47b WatchSource:0}: Error finding container fbb8b2400ccb62e0561e3fd7ec21c00e5e49d6e391ade98422e7a8afc701d47b: Status 404 returned error can't find the container with id fbb8b2400ccb62e0561e3fd7ec21c00e5e49d6e391ade98422e7a8afc701d47b
Oct 30 07:45:01.348135 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.348110    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"]
Oct 30 07:45:01.352142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.351999    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 07:45:01.352142 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.352035    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 07:45:01.523950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.523514    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"]
Oct 30 07:45:01.530230 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.530204    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"]
Oct 30 07:45:01.537684 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:01.537652    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"]
Oct 30 07:45:01.539114 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:45:01.539075    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9766dbd6_9840_4656_92d4_d63f1f12c573.slice/crio-939c0b50687039e4686fb7c9b526274736d5873cfb86635cad3d5c7f7560b949 WatchSource:0}: Error finding container 939c0b50687039e4686fb7c9b526274736d5873cfb86635cad3d5c7f7560b949: Status 404 returned error can't find the container with id 939c0b50687039e4686fb7c9b526274736d5873cfb86635cad3d5c7f7560b949
Oct 30 07:45:02.052790 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.052740    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerStarted","Data":"ea7743e52570a09b052207eee34a80ee100d64c44ee9a62909a054274a043cdc"}
Oct 30 07:45:02.054431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.054387    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerStarted","Data":"939c0b50687039e4686fb7c9b526274736d5873cfb86635cad3d5c7f7560b949"}
Oct 30 07:45:02.056169 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.056144    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerStarted","Data":"6a53060a7970156dfd190674c6a6c2a27cc9082f3c265e6373fe188e44f15781"}
Oct 30 07:45:02.056285 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.056188    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerStarted","Data":"fbb3e2adf3cbd3e6e21f7e933ff941c4ff45fc961170a8ee2f01bc05a44936e8"}
Oct 30 07:45:02.058006 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.057980    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerStarted","Data":"aeab2b86cea0a513f9213d8855a50ec967244dde865acc072648c9d46fb64cde"}
Oct 30 07:45:02.058126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.058030    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerStarted","Data":"fbb8b2400ccb62e0561e3fd7ec21c00e5e49d6e391ade98422e7a8afc701d47b"}
Oct 30 07:45:02.059797 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.059773    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerStarted","Data":"c45a5baa340b86dfa17b4d4af5609fa10af9fc1a29ff7fe828ff6a4e75ce62cd"}
Oct 30 07:45:02.145330 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.145264    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" podStartSLOduration=2.145248031 podStartE2EDuration="2.145248031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:02.143985726 +0000 UTC m=+2904.851865910" watchObservedRunningTime="2026-10-30 07:45:02.145248031 +0000 UTC m=+2904.853128199"
Oct 30 07:45:02.148044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.148002    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" podStartSLOduration=2.147989215 podStartE2EDuration="2.147989215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:02.106172668 +0000 UTC m=+2904.814052837" watchObservedRunningTime="2026-10-30 07:45:02.147989215 +0000 UTC m=+2904.855869438"
Oct 30 07:45:02.351640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.351552    5073 patch_prober.go:29] interesting pod/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused" start-of-body=
Oct 30 07:45:02.351640 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:02.351620    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.175:15021/healthz/ready\": dial tcp 10.132.0.175:15021: connect: connection refused"
Oct 30 07:45:03.070424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.070339    5073 generic.go:356] "Generic (PLEG): container finished" podID="15df309f-949c-4927-8369-b0402adc63b0" containerID="16e0e72e7f867c9c6d3483bf3d227c92800a8a2561bde283492b31e4e3d5f18f" exitCode=60
Oct 30 07:45:03.070988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.070419    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerDied","Data":"16e0e72e7f867c9c6d3483bf3d227c92800a8a2561bde283492b31e4e3d5f18f"}
Oct 30 07:45:03.070988 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.070784    5073 scope.go:122] "RemoveContainer" containerID="16e0e72e7f867c9c6d3483bf3d227c92800a8a2561bde283492b31e4e3d5f18f"
Oct 30 07:45:03.072499 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.072474    5073 generic.go:356] "Generic (PLEG): container finished" podID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerID="7bb4ba0e79950135ab052785b26e34db54b7a5c3c1a3ad1a9810a3459b22fb4d" exitCode=60
Oct 30 07:45:03.072617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.072558    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerDied","Data":"7bb4ba0e79950135ab052785b26e34db54b7a5c3c1a3ad1a9810a3459b22fb4d"}
Oct 30 07:45:03.072815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.072796    5073 scope.go:122] "RemoveContainer" containerID="7bb4ba0e79950135ab052785b26e34db54b7a5c3c1a3ad1a9810a3459b22fb4d"
Oct 30 07:45:03.074665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.074640    5073 generic.go:356] "Generic (PLEG): container finished" podID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerID="6a53060a7970156dfd190674c6a6c2a27cc9082f3c265e6373fe188e44f15781" exitCode=60
Oct 30 07:45:03.074747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.074713    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerDied","Data":"6a53060a7970156dfd190674c6a6c2a27cc9082f3c265e6373fe188e44f15781"}
Oct 30 07:45:03.075064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.074958    5073 scope.go:122] "RemoveContainer" containerID="6a53060a7970156dfd190674c6a6c2a27cc9082f3c265e6373fe188e44f15781"
Oct 30 07:45:03.076658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.076639    5073 generic.go:356] "Generic (PLEG): container finished" podID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerID="aeab2b86cea0a513f9213d8855a50ec967244dde865acc072648c9d46fb64cde" exitCode=60
Oct 30 07:45:03.076967 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.076936    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerDied","Data":"aeab2b86cea0a513f9213d8855a50ec967244dde865acc072648c9d46fb64cde"}
Oct 30 07:45:03.077065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.077047    5073 scope.go:122] "RemoveContainer" containerID="aeab2b86cea0a513f9213d8855a50ec967244dde865acc072648c9d46fb64cde"
Oct 30 07:45:03.084322 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.084289    5073 generic.go:356] "Generic (PLEG): container finished" podID="13210745-d48b-426a-870a-50da51b26322" containerID="7304fc03885808543455e2d5c5fd614802c71938afcfbf761267e37603de2ba1" exitCode=60
Oct 30 07:45:03.084513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.084345    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerDied","Data":"7304fc03885808543455e2d5c5fd614802c71938afcfbf761267e37603de2ba1"}
Oct 30 07:45:03.084734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.084716    5073 scope.go:122] "RemoveContainer" containerID="7304fc03885808543455e2d5c5fd614802c71938afcfbf761267e37603de2ba1"
Oct 30 07:45:03.357937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.357861    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:45:03.358930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:03.358911    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:45:04.095649 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.095558    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerStarted","Data":"57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828"}
Oct 30 07:45:04.098009 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.097975    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerStarted","Data":"8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0"}
Oct 30 07:45:04.107121 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.107087    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerStarted","Data":"d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1"}
Oct 30 07:45:04.109615 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.109556    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerStarted","Data":"6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0"}
Oct 30 07:45:04.112198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.112166    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerStarted","Data":"50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec"}
Oct 30 07:45:04.139250 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.139189    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" podStartSLOduration=4.1391750290000004 podStartE2EDuration="4.139175029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:04.136373113 +0000 UTC m=+2906.844253284" watchObservedRunningTime="2026-10-30 07:45:04.139175029 +0000 UTC m=+2906.847055198"
Oct 30 07:45:04.219295 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.219228    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" podStartSLOduration=4.219209217 podStartE2EDuration="4.219209217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:04.215590354 +0000 UTC m=+2906.923470523" watchObservedRunningTime="2026-10-30 07:45:04.219209217 +0000 UTC m=+2906.927089389"
Oct 30 07:45:04.300415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:04.300339    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" podStartSLOduration=4.300322278 podStartE2EDuration="4.300322278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:04.299691273 +0000 UTC m=+2907.007571439" watchObservedRunningTime="2026-10-30 07:45:04.300322278 +0000 UTC m=+2907.008202450"
Oct 30 07:45:05.122385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.122344    5073 generic.go:356] "Generic (PLEG): container finished" podID="13210745-d48b-426a-870a-50da51b26322" containerID="50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec" exitCode=60
Oct 30 07:45:05.122939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.122438    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerDied","Data":"50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec"}
Oct 30 07:45:05.122939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.122531    5073 scope.go:122] "RemoveContainer" containerID="7304fc03885808543455e2d5c5fd614802c71938afcfbf761267e37603de2ba1"
Oct 30 07:45:05.123064 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.122947    5073 scope.go:122] "RemoveContainer" containerID="50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec"
Oct 30 07:45:05.123429 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:05.123398    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz_odh-ai-gateway-infra(13210745-d48b-426a-870a-50da51b26322)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" podUID="13210745-d48b-426a-870a-50da51b26322"
Oct 30 07:45:05.125745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.125723    5073 generic.go:356] "Generic (PLEG): container finished" podID="15df309f-949c-4927-8369-b0402adc63b0" containerID="57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828" exitCode=60
Oct 30 07:45:05.126130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.125812    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerDied","Data":"57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828"}
Oct 30 07:45:05.126217 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.126173    5073 scope.go:122] "RemoveContainer" containerID="57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828"
Oct 30 07:45:05.126566 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:05.126543    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k_odh-ai-gateway-infra(15df309f-949c-4927-8369-b0402adc63b0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" podUID="15df309f-949c-4927-8369-b0402adc63b0"
Oct 30 07:45:05.127924 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.127899    5073 generic.go:356] "Generic (PLEG): container finished" podID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerID="8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0" exitCode=60
Oct 30 07:45:05.128029 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.127929    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerDied","Data":"8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0"}
Oct 30 07:45:05.128261 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.128244    5073 scope.go:122] "RemoveContainer" containerID="8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0"
Oct 30 07:45:05.128644 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:05.128609    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh_odh-ai-gateway-infra(9766dbd6-9840-4656-92d4-d63f1f12c573)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573"
Oct 30 07:45:05.130157 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.130134    5073 generic.go:356] "Generic (PLEG): container finished" podID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerID="d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1" exitCode=60
Oct 30 07:45:05.130287 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.130218    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerDied","Data":"d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1"}
Oct 30 07:45:05.130475 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.130458    5073 scope.go:122] "RemoveContainer" containerID="d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1"
Oct 30 07:45:05.130835 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:05.130809    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g_odh-ai-gateway-infra(06a8ae33-21ed-462a-bfc4-816e7395dd64)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64"
Oct 30 07:45:05.132395 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.132369    5073 generic.go:356] "Generic (PLEG): container finished" podID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerID="6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0" exitCode=60
Oct 30 07:45:05.132500 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.132412    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerDied","Data":"6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0"}
Oct 30 07:45:05.132681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.132667    5073 scope.go:122] "RemoveContainer" containerID="6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0"
Oct 30 07:45:05.132979 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:05.132957    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x_odh-ai-gateway-infra(decfdbc3-6a20-4aba-a3a9-822240aa4814)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814"
Oct 30 07:45:05.142778 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.142751    5073 scope.go:122] "RemoveContainer" containerID="16e0e72e7f867c9c6d3483bf3d227c92800a8a2561bde283492b31e4e3d5f18f"
Oct 30 07:45:05.158969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.158938    5073 scope.go:122] "RemoveContainer" containerID="7bb4ba0e79950135ab052785b26e34db54b7a5c3c1a3ad1a9810a3459b22fb4d"
Oct 30 07:45:05.174337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.174314    5073 scope.go:122] "RemoveContainer" containerID="6a53060a7970156dfd190674c6a6c2a27cc9082f3c265e6373fe188e44f15781"
Oct 30 07:45:05.188352 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:05.188331    5073 scope.go:122] "RemoveContainer" containerID="aeab2b86cea0a513f9213d8855a50ec967244dde865acc072648c9d46fb64cde"
Oct 30 07:45:06.143446 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:06.143413    5073 scope.go:122] "RemoveContainer" containerID="50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec"
Oct 30 07:45:06.144011 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:06.143894    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz_odh-ai-gateway-infra(13210745-d48b-426a-870a-50da51b26322)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" podUID="13210745-d48b-426a-870a-50da51b26322"
Oct 30 07:45:06.145403 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:06.145383    5073 scope.go:122] "RemoveContainer" containerID="57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828"
Oct 30 07:45:06.145737 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:06.145715    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k_odh-ai-gateway-infra(15df309f-949c-4927-8369-b0402adc63b0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" podUID="15df309f-949c-4927-8369-b0402adc63b0"
Oct 30 07:45:06.147035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:06.147016    5073 scope.go:122] "RemoveContainer" containerID="8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0"
Oct 30 07:45:06.147333 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:06.147309    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh_odh-ai-gateway-infra(9766dbd6-9840-4656-92d4-d63f1f12c573)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573"
Oct 30 07:45:06.148623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:06.148601    5073 scope.go:122] "RemoveContainer" containerID="d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1"
Oct 30 07:45:06.148928 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:06.148908    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g_odh-ai-gateway-infra(06a8ae33-21ed-462a-bfc4-816e7395dd64)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64"
Oct 30 07:45:06.150134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:06.150115    5073 scope.go:122] "RemoveContainer" containerID="6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0"
Oct 30 07:45:06.150354 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:06.150337    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x_odh-ai-gateway-infra(decfdbc3-6a20-4aba-a3a9-822240aa4814)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814"
Oct 30 07:45:13.924521 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:13.924476    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:45:16.414467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:16.414432    5073 scope.go:122] "RemoveContainer" containerID="d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1"
Oct 30 07:45:16.415024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:16.414547    5073 scope.go:122] "RemoveContainer" containerID="6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0"
Oct 30 07:45:16.415024 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:16.414705    5073 scope.go:122] "RemoveContainer" containerID="57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828"
Oct 30 07:45:17.241492 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:17.241402    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerStarted","Data":"89303363c1bdff9f0fc5b12d55d7b56aea57b2afa46adc710ce1efca01636980"}
Oct 30 07:45:17.243353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:17.243326    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerStarted","Data":"61bb03ae7172d50546ced3f5a669082573d15e0c294959a06d34ac096dd95de3"}
Oct 30 07:45:17.245361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:17.245340    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerStarted","Data":"c8337fa70736d6ebb1d8d4c8e21745404eae1f4fa2087087cb29ccedc2d919e3"}
Oct 30 07:45:17.420533 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:17.420501    5073 scope.go:122] "RemoveContainer" containerID="8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0"
Oct 30 07:45:18.256010 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.255930    5073 generic.go:356] "Generic (PLEG): container finished" podID="15df309f-949c-4927-8369-b0402adc63b0" containerID="89303363c1bdff9f0fc5b12d55d7b56aea57b2afa46adc710ce1efca01636980" exitCode=60
Oct 30 07:45:18.256010 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.255996    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerDied","Data":"89303363c1bdff9f0fc5b12d55d7b56aea57b2afa46adc710ce1efca01636980"}
Oct 30 07:45:18.256224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.256055    5073 scope.go:122] "RemoveContainer" containerID="57976f69b1fc28f31b96ecc8115f18787733b64a19ae20a7d3067472114e1828"
Oct 30 07:45:18.256477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.256456    5073 scope.go:122] "RemoveContainer" containerID="89303363c1bdff9f0fc5b12d55d7b56aea57b2afa46adc710ce1efca01636980"
Oct 30 07:45:18.256894 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:18.256865    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k_odh-ai-gateway-infra(15df309f-949c-4927-8369-b0402adc63b0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" podUID="15df309f-949c-4927-8369-b0402adc63b0"
Oct 30 07:45:18.258302 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.258275    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerStarted","Data":"47bbf2b7e811edb5bdc173d776b35cde3f263443acae8b27ad1ff956e55e6dee"}
Oct 30 07:45:18.260136 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.260112    5073 generic.go:356] "Generic (PLEG): container finished" podID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerID="61bb03ae7172d50546ced3f5a669082573d15e0c294959a06d34ac096dd95de3" exitCode=60
Oct 30 07:45:18.260242 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.260179    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerDied","Data":"61bb03ae7172d50546ced3f5a669082573d15e0c294959a06d34ac096dd95de3"}
Oct 30 07:45:18.260482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.260463    5073 scope.go:122] "RemoveContainer" containerID="61bb03ae7172d50546ced3f5a669082573d15e0c294959a06d34ac096dd95de3"
Oct 30 07:45:18.260721 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:18.260698    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g_odh-ai-gateway-infra(06a8ae33-21ed-462a-bfc4-816e7395dd64)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64"
Oct 30 07:45:18.262165 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.262146    5073 generic.go:356] "Generic (PLEG): container finished" podID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerID="c8337fa70736d6ebb1d8d4c8e21745404eae1f4fa2087087cb29ccedc2d919e3" exitCode=60
Oct 30 07:45:18.262252 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.262223    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerDied","Data":"c8337fa70736d6ebb1d8d4c8e21745404eae1f4fa2087087cb29ccedc2d919e3"}
Oct 30 07:45:18.262507 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.262492    5073 scope.go:122] "RemoveContainer" containerID="c8337fa70736d6ebb1d8d4c8e21745404eae1f4fa2087087cb29ccedc2d919e3"
Oct 30 07:45:18.262714 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:18.262696    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x_odh-ai-gateway-infra(decfdbc3-6a20-4aba-a3a9-822240aa4814)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814"
Oct 30 07:45:18.271145 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.271114    5073 scope.go:122] "RemoveContainer" containerID="d2c0d9dfe88192a7693c26ac6e2e948980ef1412069d5fe94abfa9993df22ab1"
Oct 30 07:45:18.286173 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.286154    5073 scope.go:122] "RemoveContainer" containerID="6e27dff087d3cfe2e23f56effd4cd5d923d1a997f2f0c49d84153ad42e313ee0"
Oct 30 07:45:18.324999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.324973    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"]
Oct 30 07:45:18.352657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.352621    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"]
Oct 30 07:45:18.401342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.401311    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"]
Oct 30 07:45:18.415399 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:18.415334    5073 scope.go:122] "RemoveContainer" containerID="50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec"
Oct 30 07:45:19.277634 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.277596    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerStarted","Data":"840b85a41312074b084fd2beba66db1bd324821f5589b24e902ad229c2ba21aa"}
Oct 30 07:45:19.282661 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.282629    5073 generic.go:356] "Generic (PLEG): container finished" podID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerID="47bbf2b7e811edb5bdc173d776b35cde3f263443acae8b27ad1ff956e55e6dee" exitCode=60
Oct 30 07:45:19.282777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.282693    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerDied","Data":"47bbf2b7e811edb5bdc173d776b35cde3f263443acae8b27ad1ff956e55e6dee"}
Oct 30 07:45:19.282777 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.282732    5073 scope.go:122] "RemoveContainer" containerID="8d29428f9810bd3ac8ab8cdb3a4f194985e4166a14698a9567a1a61f525a32e0"
Oct 30 07:45:19.283140 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.283121    5073 scope.go:122] "RemoveContainer" containerID="47bbf2b7e811edb5bdc173d776b35cde3f263443acae8b27ad1ff956e55e6dee"
Oct 30 07:45:19.283483 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:19.283462    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh_odh-ai-gateway-infra(9766dbd6-9840-4656-92d4-d63f1f12c573)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573"
Oct 30 07:45:19.435847 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.434762    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"]
Oct 30 07:45:19.522957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.520687    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:19.533094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.532424    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2\" (UniqueName: \"kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2\") pod \"06a8ae33-21ed-462a-bfc4-816e7395dd64\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") "
Oct 30 07:45:19.533094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.532488    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca\") pod \"06a8ae33-21ed-462a-bfc4-816e7395dd64\" (UID: \"06a8ae33-21ed-462a-bfc4-816e7395dd64\") "
Oct 30 07:45:19.533923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.533652    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca" pod "06a8ae33-21ed-462a-bfc4-816e7395dd64" (UID: "06a8ae33-21ed-462a-bfc4-816e7395dd64"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:45:19.539423 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.539383    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2" pod "06a8ae33-21ed-462a-bfc4-816e7395dd64" (UID: "06a8ae33-21ed-462a-bfc4-816e7395dd64"). InnerVolumeSpecName "kube-api-access-68zw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:45:19.635683 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.635641    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68zw2\" (UniqueName: \"kubernetes.io/projected/06a8ae33-21ed-462a-bfc4-816e7395dd64-kube-api-access-68zw2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:19.635899 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.635686    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06a8ae33-21ed-462a-bfc4-816e7395dd64-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:19.673749 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.673722    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:19.679063 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.679038    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:19.736981 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.736946    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8\" (UniqueName: \"kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8\") pod \"15df309f-949c-4927-8369-b0402adc63b0\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") "
Oct 30 07:45:19.737161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.737138    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca\") pod \"15df309f-949c-4927-8369-b0402adc63b0\" (UID: \"15df309f-949c-4927-8369-b0402adc63b0\") "
Oct 30 07:45:19.738326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.737316    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc\" (UniqueName: \"kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc\") pod \"decfdbc3-6a20-4aba-a3a9-822240aa4814\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") "
Oct 30 07:45:19.738326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.737388    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca\") pod \"decfdbc3-6a20-4aba-a3a9-822240aa4814\" (UID: \"decfdbc3-6a20-4aba-a3a9-822240aa4814\") "
Oct 30 07:45:19.738326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.737684    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca" pod "15df309f-949c-4927-8369-b0402adc63b0" (UID: "15df309f-949c-4927-8369-b0402adc63b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:45:19.738326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.738078    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca" pod "decfdbc3-6a20-4aba-a3a9-822240aa4814" (UID: "decfdbc3-6a20-4aba-a3a9-822240aa4814"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:45:19.738326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.738277    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/decfdbc3-6a20-4aba-a3a9-822240aa4814-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:19.738326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.738301    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15df309f-949c-4927-8369-b0402adc63b0-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:19.740893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.739360    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8" pod "15df309f-949c-4927-8369-b0402adc63b0" (UID: "15df309f-949c-4927-8369-b0402adc63b0"). InnerVolumeSpecName "kube-api-access-hf2m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:45:19.740893 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.740303    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc" pod "decfdbc3-6a20-4aba-a3a9-822240aa4814" (UID: "decfdbc3-6a20-4aba-a3a9-822240aa4814"). InnerVolumeSpecName "kube-api-access-x6lcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:45:19.839618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.839542    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6lcc\" (UniqueName: \"kubernetes.io/projected/decfdbc3-6a20-4aba-a3a9-822240aa4814-kube-api-access-x6lcc\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:19.839618 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:19.839570    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf2m8\" (UniqueName: \"kubernetes.io/projected/15df309f-949c-4927-8369-b0402adc63b0-kube-api-access-hf2m8\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:20.296189 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.296157    5073 generic.go:356] "Generic (PLEG): container finished" podID="13210745-d48b-426a-870a-50da51b26322" containerID="840b85a41312074b084fd2beba66db1bd324821f5589b24e902ad229c2ba21aa" exitCode=60
Oct 30 07:45:20.296705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.296227    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerDied","Data":"840b85a41312074b084fd2beba66db1bd324821f5589b24e902ad229c2ba21aa"}
Oct 30 07:45:20.296705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.296304    5073 scope.go:122] "RemoveContainer" containerID="50b15e1f257e9a020b91b6ea87e17d2086fbab5b84114147ddec279e5d90afec"
Oct 30 07:45:20.296841 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.296801    5073 scope.go:122] "RemoveContainer" containerID="840b85a41312074b084fd2beba66db1bd324821f5589b24e902ad229c2ba21aa"
Oct 30 07:45:20.297286 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:20.297248    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz_odh-ai-gateway-infra(13210745-d48b-426a-870a-50da51b26322)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" podUID="13210745-d48b-426a-870a-50da51b26322"
Oct 30 07:45:20.298223 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.298195    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k" event={"ID":"15df309f-949c-4927-8369-b0402adc63b0","Type":"ContainerDied","Data":"ea7743e52570a09b052207eee34a80ee100d64c44ee9a62909a054274a043cdc"}
Oct 30 07:45:20.298350 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.298207    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"
Oct 30 07:45:20.301644 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.301613    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g" event={"ID":"06a8ae33-21ed-462a-bfc4-816e7395dd64","Type":"ContainerDied","Data":"fbb3e2adf3cbd3e6e21f7e933ff941c4ff45fc961170a8ee2f01bc05a44936e8"}
Oct 30 07:45:20.301745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.301718    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"
Oct 30 07:45:20.312307 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.312275    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x" event={"ID":"decfdbc3-6a20-4aba-a3a9-822240aa4814","Type":"ContainerDied","Data":"fbb8b2400ccb62e0561e3fd7ec21c00e5e49d6e391ade98422e7a8afc701d47b"}
Oct 30 07:45:20.312417 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.312402    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"
Oct 30 07:45:20.313327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.313308    5073 scope.go:122] "RemoveContainer" containerID="89303363c1bdff9f0fc5b12d55d7b56aea57b2afa46adc710ce1efca01636980"
Oct 30 07:45:20.328114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.328089    5073 scope.go:122] "RemoveContainer" containerID="61bb03ae7172d50546ced3f5a669082573d15e0c294959a06d34ac096dd95de3"
Oct 30 07:45:20.339711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.339684    5073 scope.go:122] "RemoveContainer" containerID="c8337fa70736d6ebb1d8d4c8e21745404eae1f4fa2087087cb29ccedc2d919e3"
Oct 30 07:45:20.430047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.430012    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"]
Oct 30 07:45:20.434594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.434566    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-bd8589-29889105-q5p9g"]
Oct 30 07:45:20.482236 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.482205    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:20.499657 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.499623    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"]
Oct 30 07:45:20.514957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.514925    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"]
Oct 30 07:45:20.519325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.519137    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-2eda2c-29889105-5kx7k"]
Oct 30 07:45:20.549048 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.548963    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca\") pod \"9766dbd6-9840-4656-92d4-d63f1f12c573\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") "
Oct 30 07:45:20.549207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.549178    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4\" (UniqueName: \"kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4\") pod \"9766dbd6-9840-4656-92d4-d63f1f12c573\" (UID: \"9766dbd6-9840-4656-92d4-d63f1f12c573\") "
Oct 30 07:45:20.549413 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.549386    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca" pod "9766dbd6-9840-4656-92d4-d63f1f12c573" (UID: "9766dbd6-9840-4656-92d4-d63f1f12c573"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:45:20.549811 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.549787    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9766dbd6-9840-4656-92d4-d63f1f12c573-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:20.551389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.551369    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4" pod "9766dbd6-9840-4656-92d4-d63f1f12c573" (UID: "9766dbd6-9840-4656-92d4-d63f1f12c573"). InnerVolumeSpecName "kube-api-access-f8dg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:45:20.564299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.564274    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"]
Oct 30 07:45:20.578758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.578728    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-06e19a-29889105-b6r6x"]
Oct 30 07:45:20.651597 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:20.651557    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8dg4\" (UniqueName: \"kubernetes.io/projected/9766dbd6-9840-4656-92d4-d63f1f12c573-kube-api-access-f8dg4\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:21.330305 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.330272    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh" event={"ID":"9766dbd6-9840-4656-92d4-d63f1f12c573","Type":"ContainerDied","Data":"939c0b50687039e4686fb7c9b526274736d5873cfb86635cad3d5c7f7560b949"}
Oct 30 07:45:21.330710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.330322    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"
Oct 30 07:45:21.330710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.330360    5073 scope.go:122] "RemoveContainer" containerID="47bbf2b7e811edb5bdc173d776b35cde3f263443acae8b27ad1ff956e55e6dee"
Oct 30 07:45:21.466431 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.466394    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" path="/var/lib/kubelet/pods/06a8ae33-21ed-462a-bfc4-816e7395dd64/volumes"
Oct 30 07:45:21.467505 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.467479    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15df309f-949c-4927-8369-b0402adc63b0" path="/var/lib/kubelet/pods/15df309f-949c-4927-8369-b0402adc63b0/volumes"
Oct 30 07:45:21.468259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.468239    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" path="/var/lib/kubelet/pods/decfdbc3-6a20-4aba-a3a9-822240aa4814/volumes"
Oct 30 07:45:21.471286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.471261    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"]
Oct 30 07:45:21.471455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.471441    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889105-qhjfh"]
Oct 30 07:45:21.588227 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.588135    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:21.685927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.685877    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca\") pod \"13210745-d48b-426a-870a-50da51b26322\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") "
Oct 30 07:45:21.686130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.686070    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs\" (UniqueName: \"kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs\") pod \"13210745-d48b-426a-870a-50da51b26322\" (UID: \"13210745-d48b-426a-870a-50da51b26322\") "
Oct 30 07:45:21.686353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.686323    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca" pod "13210745-d48b-426a-870a-50da51b26322" (UID: "13210745-d48b-426a-870a-50da51b26322"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:45:21.686986 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.686956    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13210745-d48b-426a-870a-50da51b26322-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:21.690208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.690180    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs" pod "13210745-d48b-426a-870a-50da51b26322" (UID: "13210745-d48b-426a-870a-50da51b26322"). InnerVolumeSpecName "kube-api-access-d76gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:45:21.789302 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:21.789258    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d76gs\" (UniqueName: \"kubernetes.io/projected/13210745-d48b-426a-870a-50da51b26322-kube-api-access-d76gs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:45:22.342620 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:22.342583    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"
Oct 30 07:45:22.343167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:22.342623    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz" event={"ID":"13210745-d48b-426a-870a-50da51b26322","Type":"ContainerDied","Data":"c45a5baa340b86dfa17b4d4af5609fa10af9fc1a29ff7fe828ff6a4e75ce62cd"}
Oct 30 07:45:22.343167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:22.342693    5073 scope.go:122] "RemoveContainer" containerID="840b85a41312074b084fd2beba66db1bd324821f5589b24e902ad229c2ba21aa"
Oct 30 07:45:22.396742 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:22.396707    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"]
Oct 30 07:45:22.410746 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:22.410712    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-c1b5d7-29889105-l7vwz"]
Oct 30 07:45:23.435402 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:23.435355    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13210745-d48b-426a-870a-50da51b26322" path="/var/lib/kubelet/pods/13210745-d48b-426a-870a-50da51b26322/volumes"
Oct 30 07:45:23.435999 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:23.435977    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" path="/var/lib/kubelet/pods/9766dbd6-9840-4656-92d4-d63f1f12c573/volumes"
Oct 30 07:45:39.937067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937027    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"]
Oct 30 07:45:39.937815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937796    5073 cpu_manager.go:414] "containerMap: removing container" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.937815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937814    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937835    5073 cpu_manager.go:414] "containerMap: removing container" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937841    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937875    5073 cpu_manager.go:414] "containerMap: removing container" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937880    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937889    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937893    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937903    5073 cpu_manager.go:414] "containerMap: removing container" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937908    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937924    5073 cpu_manager.go:414] "containerMap: removing container" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937929    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937942    5073 cpu_manager.go:414] "containerMap: removing container" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937948    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937959    5073 cpu_manager.go:414] "containerMap: removing container" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937964    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937969    5073 cpu_manager.go:414] "containerMap: removing container" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937973    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937983    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937987    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937995    5073 cpu_manager.go:414] "containerMap: removing container" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.938014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.937999    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938106    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938115    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938122    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938128    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938135    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938142    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938150    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938156    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938161    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938167    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938173    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938179    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.938763 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.938186    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:39.943361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.943343    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:39.963170 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.963135    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"]
Oct 30 07:45:39.967046 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:39.967014    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-91c8c2-serving-cert\""
Oct 30 07:45:40.056299 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.056260    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.056513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.056389    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.056513 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.056453    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.056629 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.056523    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74g2\" (UniqueName: \"kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.170878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.166021    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.170878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.166156    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.170878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.166217    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.170878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.166288    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74g2\" (UniqueName: \"kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.181576 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:40.181537    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-serving-cert: secret "maas-api-e2e-inf-a-91c8c2-serving-cert" not found
Oct 30 07:45:40.182291 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:40.182265    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls podName:02abd2a2-25cc-4a42-98c5-e67073323f95 nodeName:}" failed. No retries permitted until 2026-10-30 07:45:40.681842812 +0000 UTC m=+2943.389722979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls") pod "maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" (UID: "02abd2a2-25cc-4a42-98c5-e67073323f95") : secret "maas-api-e2e-inf-a-91c8c2-serving-cert" not found
Oct 30 07:45:40.185039 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.183878    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.206312 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.205707    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.215884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.212870    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74g2\" (UniqueName: \"kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.777309 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.777270    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.779919 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.779883    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\") pod \"maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:40.860523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:40.860487    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:41.398800 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:41.398770    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"]
Oct 30 07:45:41.402274 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:45:41.402236    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02abd2a2_25cc_4a42_98c5_e67073323f95.slice/crio-2fdb1c61894a3de3fbac92648258f10b5ec1f43c05bcc8c36dca0f66659264a8 WatchSource:0}: Error finding container 2fdb1c61894a3de3fbac92648258f10b5ec1f43c05bcc8c36dca0f66659264a8: Status 404 returned error can't find the container with id 2fdb1c61894a3de3fbac92648258f10b5ec1f43c05bcc8c36dca0f66659264a8
Oct 30 07:45:41.529631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:41.529597    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" event={"ID":"02abd2a2-25cc-4a42-98c5-e67073323f95","Type":"ContainerStarted","Data":"2fdb1c61894a3de3fbac92648258f10b5ec1f43c05bcc8c36dca0f66659264a8"}
Oct 30 07:45:42.538284 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:42.538232    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" event={"ID":"02abd2a2-25cc-4a42-98c5-e67073323f95","Type":"ContainerStarted","Data":"ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32"}
Oct 30 07:45:42.538760 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:42.538336    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:42.581892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:42.581825    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" podStartSLOduration=3.176848531 podStartE2EDuration="3.581811541s" totalImagesPullingTime="404.96301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:42.578813467 +0000 UTC m=+2945.286693637" watchObservedRunningTime="2026-10-30 07:45:42.581811541 +0000 UTC m=+2945.289691710"
Oct 30 07:45:43.885490 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.885441    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"]
Oct 30 07:45:43.886272 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886254    5073 cpu_manager.go:414] "containerMap: removing container" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886273    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15df309f-949c-4927-8369-b0402adc63b0" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886304    5073 cpu_manager.go:414] "containerMap: removing container" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886310    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13210745-d48b-426a-870a-50da51b26322" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886321    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886326    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886348    5073 cpu_manager.go:414] "containerMap: removing container" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:43.886360 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886354    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="decfdbc3-6a20-4aba-a3a9-822240aa4814" containerName="cleanup"
Oct 30 07:45:43.886636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886455    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="06a8ae33-21ed-462a-bfc4-816e7395dd64" containerName="cleanup"
Oct 30 07:45:43.886636 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.886470    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9766dbd6-9840-4656-92d4-d63f1f12c573" containerName="cleanup"
Oct 30 07:45:43.890336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.890319    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:43.906717 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.906691    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f480c6-serving-cert\""
Oct 30 07:45:43.931654 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.929678    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"]
Oct 30 07:45:43.939640 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:43.939536    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:45:43.959398 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.959357    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:43.959567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.959401    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fh6\" (UniqueName: \"kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:43.959567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.959431    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:43.959567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:43.959480    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.061076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.061045    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.061076 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.061080    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97fh6\" (UniqueName: \"kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.061289 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.061102    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.061289 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.061153    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.061373 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:44.061300    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-serving-cert: secret "maas-api-e2e-inf-b-f480c6-serving-cert" not found
Oct 30 07:45:44.061416 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:45:44.061375    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls podName:b4f00301-e8a0-40fd-bebe-59294b066359 nodeName:}" failed. No retries permitted until 2026-10-30 07:45:44.561354359 +0000 UTC m=+2947.269234508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls") pod "maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" (UID: "b4f00301-e8a0-40fd-bebe-59294b066359") : secret "maas-api-e2e-inf-b-f480c6-serving-cert" not found
Oct 30 07:45:44.062368 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.062329    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.063863 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.063827    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.171677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.129649    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fh6\" (UniqueName: \"kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.571627 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.571541    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.574357 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.574322    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\") pod \"maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:44.807287 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:44.807243    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:45.155482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:45.155448    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"]
Oct 30 07:45:45.564543 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:45.564449    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" event={"ID":"b4f00301-e8a0-40fd-bebe-59294b066359","Type":"ContainerStarted","Data":"a77a69953fb464dbfdcf646d104bfcfae901c14a75bf9284da963dc9e83d0a54"}
Oct 30 07:45:46.577369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:46.577323    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" event={"ID":"b4f00301-e8a0-40fd-bebe-59294b066359","Type":"ContainerStarted","Data":"6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709"}
Oct 30 07:45:46.577810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:46.577401    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:45:46.632303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:46.632242    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" podStartSLOduration=3.097502102 podStartE2EDuration="3.632223249s" totalImagesPullingTime="534.721147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:45:46.628292533 +0000 UTC m=+2949.336172703" watchObservedRunningTime="2026-10-30 07:45:46.632223249 +0000 UTC m=+2949.340103419"
Oct 30 07:45:48.553358 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:48.553329    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:45:52.592393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:45:52.592353    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:46:13.923828 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:46:13.923781    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:46:39.454808 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:39.454775    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:46:39.459846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:39.459825    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:46:40.356983 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:40.356947    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 07:46:40.357177 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:40.357003    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:46:42.553514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:42.553468    5073 generic.go:356] "Generic (PLEG): container finished" podID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerID="2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f" exitCode=0
Oct 30 07:46:42.554084 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:42.553635    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" event={"ID":"b856fb82-455b-4e05-b77e-e1a061545b4e","Type":"ContainerDied","Data":"2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"}
Oct 30 07:46:42.554186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:42.554167    5073 scope.go:122] "RemoveContainer" containerID="2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"
Oct 30 07:46:42.556758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:42.556716    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:46:42.556901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:42.556812    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:46:42.556901 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:42.556872    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:46:43.563920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:43.563884    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" event={"ID":"b856fb82-455b-4e05-b77e-e1a061545b4e","Type":"ContainerStarted","Data":"406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8"}
Oct 30 07:46:43.937369 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:46:43.937327    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:46:44.163844 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:44.163809    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:46:44.164092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:44.164061    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused" start-of-body=
Oct 30 07:46:44.164221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:44.164123    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused"
Oct 30 07:46:45.166772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:45.166736    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused" start-of-body=
Oct 30 07:46:45.167433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:45.167402    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused"
Oct 30 07:46:46.164244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:46.164209    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused" start-of-body=
Oct 30 07:46:46.164433 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:46.164271    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused"
Oct 30 07:46:47.164723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:47.164688    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused" start-of-body=
Oct 30 07:46:47.165176 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:47.164742    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused"
Oct 30 07:46:48.164070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:48.164032    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused" start-of-body=
Oct 30 07:46:48.164274 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:48.164100    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused"
Oct 30 07:46:49.163889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:49.163812    5073 patch_prober.go:29] interesting pod/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused" start-of-body=
Oct 30 07:46:49.164311 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:49.163892    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.177:15021/healthz/ready\": dial tcp 10.132.0.177:15021: connect: connection refused"
Oct 30 07:46:50.319877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:50.314244    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:46:50.319877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:50.316076    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:46:50.328591 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:46:50.328558    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:47:13.928298 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:47:13.928260    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:47:18.542911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:18.539939    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:47:18.554003 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:18.552949    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": context deadline exceeded"
Oct 30 07:47:18.829067 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:18.828963    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 07:47:43.932110 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:47:43.932069    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:47:53.585226 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.585189    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"]
Oct 30 07:47:53.591183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.591157    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.619122 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.619091    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0e9723-serving-cert\""
Oct 30 07:47:53.623804 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.623772    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"]
Oct 30 07:47:53.627291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.627261    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.627457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.627420    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.627575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.627558    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4tn\" (UniqueName: \"kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.627658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.627645    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.729651 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.729611    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4tn\" (UniqueName: \"kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.729846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.729712    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.729949 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.729895    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.730013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.729980    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.730136 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:47:53.730114    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-serving-cert: secret "maas-api-e2e-inf-a-0e9723-serving-cert" not found
Oct 30 07:47:53.730205 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:47:53.730172    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls podName:ff90b41a-5957-4fc6-8e58-d20c0dc71470 nodeName:}" failed. No retries permitted until 2026-10-30 07:47:54.230157837 +0000 UTC m=+3076.938037988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls") pod "maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" (UID: "ff90b41a-5957-4fc6-8e58-d20c0dc71470") : secret "maas-api-e2e-inf-a-0e9723-serving-cert" not found
Oct 30 07:47:53.730530 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.730503    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.732767 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.732745    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:53.752511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:53.752484    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4tn\" (UniqueName: \"kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:54.239250 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:54.239209    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:54.241947 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:54.241921    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\") pod \"maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:54.535532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:54.535430    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:54.962985 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:54.962945    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"]
Oct 30 07:47:55.504144 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:55.504108    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" event={"ID":"ff90b41a-5957-4fc6-8e58-d20c0dc71470","Type":"ContainerStarted","Data":"53d5b0035bf105d7a506c2f65b5919afbadf199c1cdb7da9aba53223cc967f0a"}
Oct 30 07:47:56.515034 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:56.514994    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" event={"ID":"ff90b41a-5957-4fc6-8e58-d20c0dc71470","Type":"ContainerStarted","Data":"91b93120c10e0dff74803d3ea5cbb908ca02561fffed57291727ee555cad8920"}
Oct 30 07:47:56.515747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:56.515116    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:47:56.560416 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:47:56.560365    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" podStartSLOduration=2.983273655 podStartE2EDuration="3.560343157s" totalImagesPullingTime="577.069502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:47:56.555433311 +0000 UTC m=+3079.263313484" watchObservedRunningTime="2026-10-30 07:47:56.560343157 +0000 UTC m=+3079.268223367"
Oct 30 07:48:02.531595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:02.531562    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:48:14.141374 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:48:14.141328    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:48:29.891105 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:29.891068    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"]
Oct 30 07:48:29.891602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:29.891269    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy" containerID="cri-o://6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80" gracePeriod=30
Oct 30 07:48:29.903338 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:29.903303    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"]
Oct 30 07:48:29.907485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:29.907456    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"]
Oct 30 07:48:29.907697 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:29.907653    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy" containerID="cri-o://0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a" gracePeriod=30
Oct 30 07:48:29.929112 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:29.929045    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy" containerID="cri-o://7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7" gracePeriod=30
Oct 30 07:48:35.257474 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.257440    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:48:35.364293 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.364263    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:48:35.369071 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.369044    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:48:35.374701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374674    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.374799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374721    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.374799 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374753    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.374911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374790    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.374911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374843    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374910    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.375033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374941    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.375033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374955    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.375033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.374987    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375033    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375069    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375112    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375146    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375199    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.375251 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375239    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375276    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375313    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375328    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375333    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375386    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375558    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.375575 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375573    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375608    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375680    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375709    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375763    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375814    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375891    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token\") pod \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\" (UID: \"3555c316-1c3e-4ed8-9878-6c6185fa17fe\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375925    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375957    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy\") pod \"84b6db11-3fa6-4323-a310-5dc4c6249636\" (UID: \"84b6db11-3fa6-4323-a310-5dc4c6249636\") "
Oct 30 07:48:35.375994 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.375986    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs\") pod \"8b699b8c-c8d2-4158-b581-7637e62651dc\" (UID: \"8b699b8c-c8d2-4158-b581-7637e62651dc\") "
Oct 30 07:48:35.376483 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.376343    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.376595 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.376568    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.376788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.376766    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.377035 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377015    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377042    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377042    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377056    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b699b8c-c8d2-4158-b581-7637e62651dc-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377070    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377082    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377095    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377108    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.377532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377504    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:48:35.377623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377600    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:48:35.377925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377900    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.378015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.377983    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:48:35.378080 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.378004    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "kube-api-access-s9cbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:48:35.378154 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.378133    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.378378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.378357    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.378989 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.378721    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "kube-api-access-skhr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:48:35.380211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.379902    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:48:35.380211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.380022    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "kube-api-access-s8q6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:48:35.380382 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.380242    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.380613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.380557    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:48:35.380770 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.380743    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.381353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.381329    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:48:35.381511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.381489    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy" pod "3555c316-1c3e-4ed8-9878-6c6185fa17fe" (UID: "3555c316-1c3e-4ed8-9878-6c6185fa17fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.381810 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.381787    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:48:35.382389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.382369    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.382514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.382500    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy" pod "84b6db11-3fa6-4323-a310-5dc4c6249636" (UID: "84b6db11-3fa6-4323-a310-5dc4c6249636"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:48:35.383089 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.383070    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo" pod "8b699b8c-c8d2-4158-b581-7637e62651dc" (UID: "8b699b8c-c8d2-4158-b581-7637e62651dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509869    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509903    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8q6v\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-kube-api-access-s8q6v\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509934    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509947    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509960    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509973    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509985    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.509997    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510010    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510023    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510036    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510049    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510063    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b6db11-3fa6-4323-a310-5dc4c6249636-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510076    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510087    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510100    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9cbv\" (UniqueName: \"kubernetes.io/projected/8b699b8c-c8d2-4158-b581-7637e62651dc-kube-api-access-s9cbv\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510112    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510125    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skhr8\" (UniqueName: \"kubernetes.io/projected/3555c316-1c3e-4ed8-9878-6c6185fa17fe-kube-api-access-skhr8\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510137    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3555c316-1c3e-4ed8-9878-6c6185fa17fe-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.511821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.510148    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b6db11-3fa6-4323-a310-5dc4c6249636-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:48:35.980416 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.980382    5073 generic.go:356] "Generic (PLEG): container finished" podID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerID="6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80" exitCode=0
Oct 30 07:48:35.980612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.980432    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"
Oct 30 07:48:35.980612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.980464    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" event={"ID":"8b699b8c-c8d2-4158-b581-7637e62651dc","Type":"ContainerDied","Data":"6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80"}
Oct 30 07:48:35.980612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.980530    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x" event={"ID":"8b699b8c-c8d2-4158-b581-7637e62651dc","Type":"ContainerDied","Data":"3c3e1e97648cbe8a2d37497377e8561ba444664a0d475fc72406be8bae6f263c"}
Oct 30 07:48:35.980612 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.980559    5073 scope.go:122] "RemoveContainer" containerID="6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80"
Oct 30 07:48:35.982406 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.982382    5073 generic.go:356] "Generic (PLEG): container finished" podID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerID="7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7" exitCode=0
Oct 30 07:48:35.982562 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.982430    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"
Oct 30 07:48:35.982713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.982555    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" event={"ID":"3555c316-1c3e-4ed8-9878-6c6185fa17fe","Type":"ContainerDied","Data":"7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7"}
Oct 30 07:48:35.982713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.982601    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr" event={"ID":"3555c316-1c3e-4ed8-9878-6c6185fa17fe","Type":"ContainerDied","Data":"1b7440947a4085c28a215eec5e5d4ad4f5d1ec1c8ade58a8ab124382fd5ef39a"}
Oct 30 07:48:35.984470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.984439    5073 generic.go:356] "Generic (PLEG): container finished" podID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerID="0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a" exitCode=0
Oct 30 07:48:35.984587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.984519    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" event={"ID":"84b6db11-3fa6-4323-a310-5dc4c6249636","Type":"ContainerDied","Data":"0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a"}
Oct 30 07:48:35.984587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.984557    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk" event={"ID":"84b6db11-3fa6-4323-a310-5dc4c6249636","Type":"ContainerDied","Data":"f31edb3eb484bac35272fa07235766f070e1b463129a4540b73c29aab523c194"}
Oct 30 07:48:35.984713 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.984621    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"
Oct 30 07:48:35.994462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.994441    5073 scope.go:122] "RemoveContainer" containerID="6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80"
Oct 30 07:48:35.994781 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:48:35.994744    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80\": container with ID starting with 6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80 not found: ID does not exist" containerID="6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80"
Oct 30 07:48:35.994925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.994788    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80"} err="failed to get container status \"6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80\": rpc error: code = NotFound desc = could not find container \"6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80\": container with ID starting with 6695ba94952ee175aa376b7bac74eefe53cd190c2aec1de1b7c8f60e249d0f80 not found: ID does not exist"
Oct 30 07:48:35.994925 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:35.994806    5073 scope.go:122] "RemoveContainer" containerID="7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7"
Oct 30 07:48:36.008348 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.008327    5073 scope.go:122] "RemoveContainer" containerID="7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7"
Oct 30 07:48:36.008745 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:48:36.008719    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7\": container with ID starting with 7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7 not found: ID does not exist" containerID="7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7"
Oct 30 07:48:36.008834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.008754    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7"} err="failed to get container status \"7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7\": rpc error: code = NotFound desc = could not find container \"7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7\": container with ID starting with 7f03eab47573b347cc401a26e88be79899f272533394359e5aac1776465badf7 not found: ID does not exist"
Oct 30 07:48:36.008834 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.008777    5073 scope.go:122] "RemoveContainer" containerID="0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a"
Oct 30 07:48:36.021158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.021138    5073 scope.go:122] "RemoveContainer" containerID="0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a"
Oct 30 07:48:36.021435 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:48:36.021414    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a\": container with ID starting with 0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a not found: ID does not exist" containerID="0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a"
Oct 30 07:48:36.021480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.021446    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a"} err="failed to get container status \"0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a\": rpc error: code = NotFound desc = could not find container \"0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a\": container with ID starting with 0d16d5560d4a5c06c5069e91c5a71916f8b7f9e4a0c2f10d8c7cb2db7fe3ce1a not found: ID does not exist"
Oct 30 07:48:36.032781 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.032760    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"]
Oct 30 07:48:36.044538 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.044509    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mrg7x"]
Oct 30 07:48:36.073342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.073318    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"]
Oct 30 07:48:36.079281 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.079258    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-cnvbk"]
Oct 30 07:48:36.111000 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.110941    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"]
Oct 30 07:48:36.119040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:36.119015    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-wh8zr"]
Oct 30 07:48:37.437927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:37.437845    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" path="/var/lib/kubelet/pods/3555c316-1c3e-4ed8-9878-6c6185fa17fe/volumes"
Oct 30 07:48:37.447325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:37.447297    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" path="/var/lib/kubelet/pods/84b6db11-3fa6-4323-a310-5dc4c6249636/volumes"
Oct 30 07:48:37.448375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:48:37.448345    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" path="/var/lib/kubelet/pods/8b699b8c-c8d2-4158-b581-7637e62651dc/volumes"
Oct 30 07:48:43.927093 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:48:43.927055    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:49:05.028303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.028268    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"]
Oct 30 07:49:05.029447 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029420    5073 cpu_manager.go:414] "containerMap: removing container" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy"
Oct 30 07:49:05.029447 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029443    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy"
Oct 30 07:49:05.029648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029465    5073 cpu_manager.go:414] "containerMap: removing container" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy"
Oct 30 07:49:05.029648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029470    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy"
Oct 30 07:49:05.029648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029552    5073 cpu_manager.go:414] "containerMap: removing container" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy"
Oct 30 07:49:05.029648 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029559    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy"
Oct 30 07:49:05.029923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029737    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="84b6db11-3fa6-4323-a310-5dc4c6249636" containerName="istio-proxy"
Oct 30 07:49:05.029923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029753    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b699b8c-c8d2-4158-b581-7637e62651dc" containerName="istio-proxy"
Oct 30 07:49:05.029923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.029763    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="3555c316-1c3e-4ed8-9878-6c6185fa17fe" containerName="istio-proxy"
Oct 30 07:49:05.035945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.035921    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.063466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.063436    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"]
Oct 30 07:49:05.068468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.068438    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8514a3-openshift-default-dockercfg-jmf26\""
Oct 30 07:49:05.117077 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117047    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117223 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117093    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117223 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117212    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7z6f\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117256    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117315    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117368 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117344    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117405 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117391    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117438 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117416    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.117472 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.117447    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.222873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.221742    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.222873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.221821    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.222873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.222281    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.244878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.223347    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.287465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.262008    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.287465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.262091    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.287465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.262296    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.287465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.262331    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.287465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.262423    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7z6f\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.287465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.262487    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.301443 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.301409    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.304211 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.304186    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.304686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.304659    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.314873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.304938    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.315363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.315339    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.315754 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.315735    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.344525 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.344496    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.375877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.375168    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7z6f\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f\") pod \"e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") " pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:05.673280 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:05.673238    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:06.015914 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.005619    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"]
Oct 30 07:49:06.015914 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:49:06.012732    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921fd42f_42c8_455c_a89b_3ad9ffe0a673.slice/crio-f6c9f58a0aeb0ca313461d872ae0fc85ea682fe653d2e60fe300fb1c7459f512 WatchSource:0}: Error finding container f6c9f58a0aeb0ca313461d872ae0fc85ea682fe653d2e60fe300fb1c7459f512: Status 404 returned error can't find the container with id f6c9f58a0aeb0ca313461d872ae0fc85ea682fe653d2e60fe300fb1c7459f512
Oct 30 07:49:06.017385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.017345    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:49:06.017472 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.017436    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:49:06.017510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.017485    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:49:06.338509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.338422    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" event={"ID":"921fd42f-42c8-455c-a89b-3ad9ffe0a673","Type":"ContainerStarted","Data":"e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"}
Oct 30 07:49:06.338509 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.338483    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" event={"ID":"921fd42f-42c8-455c-a89b-3ad9ffe0a673","Type":"ContainerStarted","Data":"f6c9f58a0aeb0ca313461d872ae0fc85ea682fe653d2e60fe300fb1c7459f512"}
Oct 30 07:49:06.386421 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.386363    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podStartSLOduration=2.38634667 podStartE2EDuration="2.38634667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:49:06.38298442 +0000 UTC m=+3149.090864602" watchObservedRunningTime="2026-10-30 07:49:06.38634667 +0000 UTC m=+3149.094226838"
Oct 30 07:49:06.674730 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:06.674695    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:07.681752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:07.681718    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:08.353449 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:08.353413    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:08.354411 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:08.354390    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:49:13.985417 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:49:13.985375    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:49:24.207827 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.207790    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"]
Oct 30 07:49:24.212933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.212913    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.232286 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.232259    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"]
Oct 30 07:49:24.242183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.239215    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-896ca4-serving-cert\""
Oct 30 07:49:24.293710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.293673    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.293927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.293745    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.293927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.293877    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.294079 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.293929    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49r4\" (UniqueName: \"kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.395130 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.395091    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.395940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.395914    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49r4\" (UniqueName: \"kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.396716 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.396691    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.397731 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.397711    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.399092 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.397613    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.462878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.440546    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49r4\" (UniqueName: \"kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.463207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.447533    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.463385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.448099    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs\") pod \"maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.530295 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.530260    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:24.839889 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:49:24.837960    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0813c1d_44db_45c6_a7b5_93c859d863b6.slice/crio-9d392138d0f917fff7966196ea0bf2e3962bc66e0651880b63f0399fdf46ca09 WatchSource:0}: Error finding container 9d392138d0f917fff7966196ea0bf2e3962bc66e0651880b63f0399fdf46ca09: Status 404 returned error can't find the container with id 9d392138d0f917fff7966196ea0bf2e3962bc66e0651880b63f0399fdf46ca09
Oct 30 07:49:24.839889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.838162    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"]
Oct 30 07:49:24.839889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:24.839457    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 07:49:25.677890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:25.675267    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn" event={"ID":"f0813c1d-44db-45c6-a7b5-93c859d863b6","Type":"ContainerStarted","Data":"167cb4498f3ec74c095a0673d5372092c7c3013df4bdf8384270e8599fd8ecee"}
Oct 30 07:49:25.677890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:25.675321    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn" event={"ID":"f0813c1d-44db-45c6-a7b5-93c859d863b6","Type":"ContainerStarted","Data":"9d392138d0f917fff7966196ea0bf2e3962bc66e0651880b63f0399fdf46ca09"}
Oct 30 07:49:25.677890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:25.675490    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:25.727462 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:25.727400    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn" podStartSLOduration=1.400539271 podStartE2EDuration="1.7273823s" totalImagesPullingTime="326.843029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:49:25.725553327 +0000 UTC m=+3168.433433490" watchObservedRunningTime="2026-10-30 07:49:25.7273823 +0000 UTC m=+3168.435262474"
Oct 30 07:49:31.691539 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:49:31.691506    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:49:43.924568 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:49:43.924528    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:50:04.661254 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:04.661156    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"]
Oct 30 07:50:04.661675 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:04.661373    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy" containerID="cri-o://6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0" gracePeriod=30
Oct 30 07:50:05.604590 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:05.604546    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"]
Oct 30 07:50:05.604864 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:05.604803    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy" containerID="cri-o://8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab" gracePeriod=30
Oct 30 07:50:10.003062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.003027    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:50:10.086210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.086155    5073 generic.go:356] "Generic (PLEG): container finished" podID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerID="6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0" exitCode=0
Oct 30 07:50:10.086409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.086256    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" event={"ID":"a556e2c8-011b-4004-a3d5-bdb09e88145f","Type":"ContainerDied","Data":"6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0"}
Oct 30 07:50:10.086409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.086310    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f" event={"ID":"a556e2c8-011b-4004-a3d5-bdb09e88145f","Type":"ContainerDied","Data":"22f077ed0db0d8aa4c56c74542944ee4f9c1f7dc02c7333496bed23f4a440004"}
Oct 30 07:50:10.086409 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.086343    5073 scope.go:122] "RemoveContainer" containerID="6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0"
Oct 30 07:50:10.086585 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.086511    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"
Oct 30 07:50:10.106297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.106264    5073 scope.go:122] "RemoveContainer" containerID="6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0"
Oct 30 07:50:10.106714 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:10.106688    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0\": container with ID starting with 6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0 not found: ID does not exist" containerID="6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0"
Oct 30 07:50:10.106831 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.106726    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0"} err="failed to get container status \"6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0\": rpc error: code = NotFound desc = could not find container \"6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0\": container with ID starting with 6cb48109476b7fe7f16d5fa6a203e97901038c6f8e55b479551d34581d3d8df0 not found: ID does not exist"
Oct 30 07:50:10.174489 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.174423    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.174954 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.174906    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177142    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.176962    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.177529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177369    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177419    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177529 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177459    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177614    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177645    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.177906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.177673    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy\") pod \"a556e2c8-011b-4004-a3d5-bdb09e88145f\" (UID: \"a556e2c8-011b-4004-a3d5-bdb09e88145f\") "
Oct 30 07:50:10.178200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.178173    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.178442 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.178414    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.178537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.178465    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.178537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.178488    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.178935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.178826    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:50:10.179026 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.178954    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.182109 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.181588    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.182728 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.182123    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:50:10.182728 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.182573    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "kube-api-access-2llk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:50:10.184217 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.184147    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo" pod "a556e2c8-011b-4004-a3d5-bdb09e88145f" (UID: "a556e2c8-011b-4004-a3d5-bdb09e88145f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280144    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280176    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280186    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a556e2c8-011b-4004-a3d5-bdb09e88145f-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280195    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280203    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280210    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a556e2c8-011b-4004-a3d5-bdb09e88145f-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.280231 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.280219    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2llk8\" (UniqueName: \"kubernetes.io/projected/a556e2c8-011b-4004-a3d5-bdb09e88145f-kube-api-access-2llk8\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.439361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.439318    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"]
Oct 30 07:50:10.448982 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:10.448950    5073 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda556e2c8_011b_4004_a3d5_bdb09e88145f.slice/crio-22f077ed0db0d8aa4c56c74542944ee4f9c1f7dc02c7333496bed23f4a440004\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda556e2c8_011b_4004_a3d5_bdb09e88145f.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 07:50:10.450599 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.450577    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-8e7948-openshift-default-584c499449-gv68f"]
Oct 30 07:50:10.913823 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.913792    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:50:10.994733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.994693    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.994911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.994787    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.994911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.994833    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.994911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.994891    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.995059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.994926    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.995059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.994958    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.995059 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995013    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.995174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995049    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.995174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995068    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.995174 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995122    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy\") pod \"023336e5-6920-46d1-974f-263eb4e8b00b\" (UID: \"023336e5-6920-46d1-974f-263eb4e8b00b\") "
Oct 30 07:50:10.995354 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995316    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.995592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995569    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.995592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995585    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:10.995907 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.995886    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:50:10.996153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.996134    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.996232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.996159    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.996232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.996171    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.996232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.996184    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/023336e5-6920-46d1-974f-263eb4e8b00b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.996232 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.996198    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:10.998873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.998821    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:50:10.998979 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:10.998836    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:50:11.000693 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.000667    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "kube-api-access-k9dkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:50:11.003325 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.003299    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token" pod "023336e5-6920-46d1-974f-263eb4e8b00b" (UID: "023336e5-6920-46d1-974f-263eb4e8b00b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:50:11.104875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.101803    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/023336e5-6920-46d1-974f-263eb4e8b00b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:11.104875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.101864    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9dkv\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-kube-api-access-k9dkv\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:11.104875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.101881    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/023336e5-6920-46d1-974f-263eb4e8b00b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:11.104875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.101893    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/023336e5-6920-46d1-974f-263eb4e8b00b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:50:11.112875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.112666    5073 generic.go:356] "Generic (PLEG): container finished" podID="023336e5-6920-46d1-974f-263eb4e8b00b" containerID="8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab" exitCode=0
Oct 30 07:50:11.115210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.113322    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" event={"ID":"023336e5-6920-46d1-974f-263eb4e8b00b","Type":"ContainerDied","Data":"8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab"}
Oct 30 07:50:11.115210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.113430    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z" event={"ID":"023336e5-6920-46d1-974f-263eb4e8b00b","Type":"ContainerDied","Data":"ffb01b9597ecef29af47c784770dff85df1802b38d7c399208a0797fafd8dabd"}
Oct 30 07:50:11.115210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.113465    5073 scope.go:122] "RemoveContainer" containerID="8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab"
Oct 30 07:50:11.115210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.113605    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"
Oct 30 07:50:11.174178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.174154    5073 scope.go:122] "RemoveContainer" containerID="8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab"
Oct 30 07:50:11.174664 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:11.174642    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab\": container with ID starting with 8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab not found: ID does not exist" containerID="8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab"
Oct 30 07:50:11.174705 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.174677    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab"} err="failed to get container status \"8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab\": rpc error: code = NotFound desc = could not find container \"8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab\": container with ID starting with 8f472a48ca96f69f007e557cc0ceec6f7900f39aeb5b9f020840a792eceb8fab not found: ID does not exist"
Oct 30 07:50:11.216436 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.214377    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"]
Oct 30 07:50:11.220747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.220713    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-932c00-openshift-default-76b46f778f-wl24z"]
Oct 30 07:50:11.424807 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.424724    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" path="/var/lib/kubelet/pods/023336e5-6920-46d1-974f-263eb4e8b00b/volumes"
Oct 30 07:50:11.425357 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:11.425339    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" path="/var/lib/kubelet/pods/a556e2c8-011b-4004-a3d5-bdb09e88145f/volumes"
Oct 30 07:50:13.924931 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:13.924896    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:50:14.903587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.903552    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"]
Oct 30 07:50:14.904335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.904318    5073 cpu_manager.go:414] "containerMap: removing container" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy"
Oct 30 07:50:14.904335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.904335    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy"
Oct 30 07:50:14.904502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.904360    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy"
Oct 30 07:50:14.904502 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.904366    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy"
Oct 30 07:50:14.904614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.904542    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="023336e5-6920-46d1-974f-263eb4e8b00b" containerName="istio-proxy"
Oct 30 07:50:14.904614 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.904551    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a556e2c8-011b-4004-a3d5-bdb09e88145f" containerName="istio-proxy"
Oct 30 07:50:14.909580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.909557    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:14.928829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.928801    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"]
Oct 30 07:50:14.934934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.934910    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8514a3-serving-cert\""
Oct 30 07:50:14.959455 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.959430    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ps2r\" (UniqueName: \"kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:14.959761 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.959721    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:14.959898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.959826    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:14.959959 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:14.959905    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.061660 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.061627    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.061897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.061679    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.061897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.061726    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.061897 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:15.061766    5073 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-serving-cert: secret "maas-api-e2e-inf-b-8514a3-serving-cert" not found
Oct 30 07:50:15.061897 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:15.061825    5073 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls podName:2c3aac55-3105-4043-bb96-1bf559a5b8e2 nodeName:}" failed. No retries permitted until 2026-10-30 07:50:15.561810504 +0000 UTC m=+3218.269690651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls") pod "maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" (UID: "2c3aac55-3105-4043-bb96-1bf559a5b8e2") : secret "maas-api-e2e-inf-b-8514a3-serving-cert" not found
Oct 30 07:50:15.061897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.061893    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ps2r\" (UniqueName: \"kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.062531 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.062511    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.064495 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.064473    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.085049 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.085016    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ps2r\" (UniqueName: \"kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.573542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.573497    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.576224 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.576191    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\") pod \"maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:15.829072 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:15.828689    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:16.137413 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:50:16.137383    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3aac55_3105_4043_bb96_1bf559a5b8e2.slice/crio-7f9dfba1337100c8abf925e6dc286ae1f11d7b0c4d283706a9290352dfcafd4a WatchSource:0}: Error finding container 7f9dfba1337100c8abf925e6dc286ae1f11d7b0c4d283706a9290352dfcafd4a: Status 404 returned error can't find the container with id 7f9dfba1337100c8abf925e6dc286ae1f11d7b0c4d283706a9290352dfcafd4a
Oct 30 07:50:16.138920 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:16.138893    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"]
Oct 30 07:50:16.285878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:16.276287    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" event={"ID":"2c3aac55-3105-4043-bb96-1bf559a5b8e2","Type":"ContainerStarted","Data":"7f9dfba1337100c8abf925e6dc286ae1f11d7b0c4d283706a9290352dfcafd4a"}
Oct 30 07:50:17.286755 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:17.286720    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" event={"ID":"2c3aac55-3105-4043-bb96-1bf559a5b8e2","Type":"ContainerStarted","Data":"c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd"}
Oct 30 07:50:17.287212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:17.286812    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:17.329297 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:17.329243    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" podStartSLOduration=2.841644352 podStartE2EDuration="3.329228945s" totalImagesPullingTime="487.584593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:50:17.328506659 +0000 UTC m=+3220.036386828" watchObservedRunningTime="2026-10-30 07:50:17.329228945 +0000 UTC m=+3220.037109113"
Oct 30 07:50:23.718528 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:50:23.718037    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:50:43.926260 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:50:43.926221    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:51:05.594572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.594483    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"]
Oct 30 07:51:05.596333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.595805    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy" containerID="cri-o://a9f9b82a0223c278da7580c17d231837b0766c7440f7f7674b6a7deaaf8478f5" gracePeriod=30
Oct 30 07:51:05.905722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.896427    5073 generic.go:356] "Generic (PLEG): container finished" podID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerID="e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d" exitCode=0
Oct 30 07:51:05.905722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.896578    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" event={"ID":"921fd42f-42c8-455c-a89b-3ad9ffe0a673","Type":"ContainerDied","Data":"e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"}
Oct 30 07:51:05.905722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.897266    5073 scope.go:122] "RemoveContainer" containerID="e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"
Oct 30 07:51:05.926384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.912459    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:51:05.926384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.912564    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:51:05.926384 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:05.912607    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:51:06.906480 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:06.906446    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" event={"ID":"921fd42f-42c8-455c-a89b-3ad9ffe0a673","Type":"ContainerStarted","Data":"64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b"}
Oct 30 07:51:07.677291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:07.675688    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:51:07.677291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:07.676895    5073 patch_prober.go:29] interesting pod/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused" start-of-body=
Oct 30 07:51:07.677291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:07.676959    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused"
Oct 30 07:51:08.358880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:08.358010    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:51:08.687253 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:08.687216    5073 patch_prober.go:29] interesting pod/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused" start-of-body=
Oct 30 07:51:08.687542 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:08.687514    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused"
Oct 30 07:51:09.697159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:09.696993    5073 patch_prober.go:29] interesting pod/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused" start-of-body=
Oct 30 07:51:09.697159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:09.697055    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused"
Oct 30 07:51:10.676219 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.676183    5073 patch_prober.go:29] interesting pod/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused" start-of-body=
Oct 30 07:51:10.676535 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.676505    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused"
Oct 30 07:51:10.966233 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.966198    5073 generic.go:356] "Generic (PLEG): container finished" podID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerID="a9f9b82a0223c278da7580c17d231837b0766c7440f7f7674b6a7deaaf8478f5" exitCode=0
Oct 30 07:51:10.966659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.966279    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" event={"ID":"d0191355-f7d6-4d43-913a-976a9c45b2a3","Type":"ContainerDied","Data":"a9f9b82a0223c278da7580c17d231837b0766c7440f7f7674b6a7deaaf8478f5"}
Oct 30 07:51:10.966659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.966355    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs" event={"ID":"d0191355-f7d6-4d43-913a-976a9c45b2a3","Type":"ContainerDied","Data":"e76529d46037c3b19d415a8dd8901e7a72f915234af95777772107c7c5aa882c"}
Oct 30 07:51:10.966659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.966381    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e76529d46037c3b19d415a8dd8901e7a72f915234af95777772107c7c5aa882c"
Oct 30 07:51:10.966659 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.966401    5073 scope.go:122] "RemoveContainer" containerID="f2c05a2cbfc0d6eb0fd2911721931bc57c93ca7b66086e9f89cea6eea4ddf45f"
Oct 30 07:51:10.968918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:10.968895    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114384    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114433    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114504    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114521    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114547    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114624    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114769    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114792    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114809    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.114841    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket\") pod \"d0191355-f7d6-4d43-913a-976a9c45b2a3\" (UID: \"d0191355-f7d6-4d43-913a-976a9c45b2a3\") "
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.115585    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.115629    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.115808    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.115988    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.116280    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.118883    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.119234    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:51:11.120043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.119238    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:51:11.122987 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.122183    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl" pod "d0191355-f7d6-4d43-913a-976a9c45b2a3" (UID: "d0191355-f7d6-4d43-913a-976a9c45b2a3"). InnerVolumeSpecName "kube-api-access-7vmwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216644    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216682    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216692    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216702    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vmwl\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-kube-api-access-7vmwl\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216712    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216720    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216728    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0191355-f7d6-4d43-913a-976a9c45b2a3-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.216734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.216735    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0191355-f7d6-4d43-913a-976a9c45b2a3-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:51:11.648699 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.648669    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"]
Oct 30 07:51:11.650013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.649983    5073 cpu_manager.go:414] "containerMap: removing container" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy"
Oct 30 07:51:11.650013 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.650012    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy"
Oct 30 07:51:11.650337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.650055    5073 cpu_manager.go:414] "containerMap: removing container" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy"
Oct 30 07:51:11.650337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.650064    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy"
Oct 30 07:51:11.650337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.650225    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy"
Oct 30 07:51:11.650337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.650240    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" containerName="istio-proxy"
Oct 30 07:51:11.655594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.655569    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.669991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.669970    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f480c6-openshift-default-dockercfg-m97vg\""
Oct 30 07:51:11.696940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.694352    5073 patch_prober.go:29] interesting pod/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused" start-of-body=
Oct 30 07:51:11.696940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.694404    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.186:15021/healthz/ready\": dial tcp 10.132.0.186:15021: connect: connection refused"
Oct 30 07:51:11.769881 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.768126    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"]
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838249    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838312    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838474    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838581    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838615    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838656    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838697    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838748    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5fm\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.839911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.838793    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.939991 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.939808    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940470 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940445    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940487    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940516    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940551    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940605 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940586    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5fm\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940626    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940682    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.940846 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.940718    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.942408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.941134    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.942408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.941414    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.942408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.941636    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.942408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.941715    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.942408 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.942031    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.943871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.943828    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.946175 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.946051    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.963186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.963089    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5fm\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.963453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.963435    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token\") pod \"e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") " pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:11.998880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:11.997119    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:12.014897 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.014842    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"
Oct 30 07:51:12.121903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.118497    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"]
Oct 30 07:51:12.130155 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.130125    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ad434e-openshift-default-cc6d45f77-x22bs"]
Oct 30 07:51:12.396997 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.396961    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"]
Oct 30 07:51:12.398342 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.398305    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:51:12.398453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.398387    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:51:12.398453 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.398434    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:51:12.680747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.680668    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:51:12.681671 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:12.681647    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:51:13.027457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:13.027331    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" event={"ID":"b36915b0-0dfd-4b72-855a-8572047c6dc5","Type":"ContainerStarted","Data":"aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d"}
Oct 30 07:51:13.027457 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:13.027391    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" event={"ID":"b36915b0-0dfd-4b72-855a-8572047c6dc5","Type":"ContainerStarted","Data":"b0312f36d7965fa7eb50b3c36c833d39d3dc2bf7655a059a8277a81604971340"}
Oct 30 07:51:13.072876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:13.070445    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podStartSLOduration=2.070425778 podStartE2EDuration="2.070425778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:51:13.070395075 +0000 UTC m=+3275.778275257" watchObservedRunningTime="2026-10-30 07:51:13.070425778 +0000 UTC m=+3275.778305949"
Oct 30 07:51:13.425975 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:13.425942    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0191355-f7d6-4d43-913a-976a9c45b2a3" path="/var/lib/kubelet/pods/d0191355-f7d6-4d43-913a-976a9c45b2a3/volumes"
Oct 30 07:51:13.932795 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:51:13.932735    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:51:14.001821 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:13.998331    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:14.003159 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:14.003127    5073 patch_prober.go:29] interesting pod/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused" start-of-body=
Oct 30 07:51:14.003283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:14.003185    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused"
Oct 30 07:51:14.998523 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:14.998487    5073 patch_prober.go:29] interesting pod/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused" start-of-body=
Oct 30 07:51:14.998968 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:14.998550    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused"
Oct 30 07:51:15.999890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:15.999167    5073 patch_prober.go:29] interesting pod/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused" start-of-body=
Oct 30 07:51:15.999890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:15.999227    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused"
Oct 30 07:51:17.007886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:16.999612    5073 patch_prober.go:29] interesting pod/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused" start-of-body=
Oct 30 07:51:17.007886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:16.999675    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused"
Oct 30 07:51:18.004466 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:18.004254    5073 patch_prober.go:29] interesting pod/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused" start-of-body=
Oct 30 07:51:18.004721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:18.004689    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.189:15021/healthz/ready\": dial tcp 10.132.0.189:15021: connect: connection refused"
Oct 30 07:51:19.204623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:19.204346    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:19.205784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:19.205716    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:19.206990 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:19.206971    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:51:38.890208 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:38.890165    5073 scope.go:122] "RemoveContainer" containerID="a9f9b82a0223c278da7580c17d231837b0766c7440f7f7674b6a7deaaf8478f5"
Oct 30 07:51:39.534826 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:39.534798    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:51:39.538202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:51:39.538176    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:51:43.929833 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:51:43.929794    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:52:00.566871 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:00.566830    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"]
Oct 30 07:52:00.567388 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:00.567047    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy" containerID="cri-o://a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458" gracePeriod=30
Oct 30 07:52:05.868075 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.868049    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:52:05.986437 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986396    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.986647 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986573    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.986721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986662    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.986784 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986718    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.986880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986836    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.986956 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986909    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.987014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986957    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.987014 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.986993    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.987126 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.987080    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy\") pod \"83f1aa75-34b6-47b8-819a-432113cdd7e4\" (UID: \"83f1aa75-34b6-47b8-819a-432113cdd7e4\") "
Oct 30 07:52:05.988511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.988213    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:52:05.988641 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.988560    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:52:05.988817 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.988795    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:52:05.989008 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.988924    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:52:05.989245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.989221    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:52:05.990468 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.990433    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:52:05.990656 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.990633    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:52:05.991417 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.991383    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "kube-api-access-g6qc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:52:05.992267 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:05.992242    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token" pod "83f1aa75-34b6-47b8-819a-432113cdd7e4" (UID: "83f1aa75-34b6-47b8-819a-432113cdd7e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088783    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088811    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088822    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088832    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6qc2\" (UniqueName: \"kubernetes.io/projected/83f1aa75-34b6-47b8-819a-432113cdd7e4-kube-api-access-g6qc2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088885    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088896    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83f1aa75-34b6-47b8-819a-432113cdd7e4-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088904    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088912    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.088911 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.088920    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83f1aa75-34b6-47b8-819a-432113cdd7e4-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:52:06.611339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.611297    5073 generic.go:356] "Generic (PLEG): container finished" podID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerID="a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458" exitCode=0
Oct 30 07:52:06.611564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.611352    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"
Oct 30 07:52:06.611564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.611337    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" event={"ID":"83f1aa75-34b6-47b8-819a-432113cdd7e4","Type":"ContainerDied","Data":"a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458"}
Oct 30 07:52:06.611564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.611488    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc" event={"ID":"83f1aa75-34b6-47b8-819a-432113cdd7e4","Type":"ContainerDied","Data":"b92a9e8b767781af23938e7b25b57f4ab97bda7985c0bce44ab0991ff48a41f5"}
Oct 30 07:52:06.611564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.611523    5073 scope.go:122] "RemoveContainer" containerID="a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458"
Oct 30 07:52:06.627344 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.627319    5073 scope.go:122] "RemoveContainer" containerID="a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458"
Oct 30 07:52:06.627656 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:52:06.627636    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458\": container with ID starting with a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458 not found: ID does not exist" containerID="a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458"
Oct 30 07:52:06.627727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.627665    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458"} err="failed to get container status \"a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458\": rpc error: code = NotFound desc = could not find container \"a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458\": container with ID starting with a08f22b3fd2bc7bfbf5ae20a02aa6db35ad8861d6dd795872d3beb4b5de0f458 not found: ID does not exist"
Oct 30 07:52:06.708918 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.708884    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"]
Oct 30 07:52:06.725866 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:06.725823    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-a8f1df-openshift-default-6bd8db459c-52xjc"]
Oct 30 07:52:07.428377 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:52:07.428329    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" path="/var/lib/kubelet/pods/83f1aa75-34b6-47b8-819a-432113cdd7e4/volumes"
Oct 30 07:52:13.925201 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:52:13.925156    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:52:43.925739 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:52:43.925693    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:53:12.490658 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:12.490459    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"]
Oct 30 07:53:12.491592 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:12.491509    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns" podUID="b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" containerName="maas-api" containerID="cri-o://e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5" gracePeriod=30
Oct 30 07:53:12.968452 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:12.968055    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:53:13.074877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.062523    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k\" (UniqueName: \"kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k\") pod \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") "
Oct 30 07:53:13.074877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.062790    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls\") pod \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") "
Oct 30 07:53:13.074877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.063058    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs\") pod \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") "
Oct 30 07:53:13.074877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.063094    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca\") pod \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\" (UID: \"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08\") "
Oct 30 07:53:13.074877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.068089    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca" pod "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" (UID: "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:53:13.115873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.108650    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k" pod "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" (UID: "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08"). InnerVolumeSpecName "kube-api-access-rkc2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:53:13.165906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.164258    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs" pod "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" (UID: "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:53:13.165906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.165556    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkc2k\" (UniqueName: \"kubernetes.io/projected/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-kube-api-access-rkc2k\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:13.165906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.165581    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:13.165906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.165593    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:13.191556 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.191516    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls" pod "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" (UID: "b1c2ebbb-2d28-413d-9f48-ea7164c7fb08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:53:13.256160 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.256120    5073 generic.go:356] "Generic (PLEG): container finished" podID="b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" containerID="e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5" exitCode=0
Oct 30 07:53:13.256326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.256170    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"
Oct 30 07:53:13.256326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.256198    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns" event={"ID":"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08","Type":"ContainerDied","Data":"e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5"}
Oct 30 07:53:13.256326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.256253    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns" event={"ID":"b1c2ebbb-2d28-413d-9f48-ea7164c7fb08","Type":"ContainerDied","Data":"327d7b93fe235046bd169c14d0c47c9f7193201aa5f9aef4d4b62be3c7225f36"}
Oct 30 07:53:13.256326 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.256277    5073 scope.go:122] "RemoveContainer" containerID="e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5"
Oct 30 07:53:13.267514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.267426    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:13.267598 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.267536    5073 scope.go:122] "RemoveContainer" containerID="e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5"
Oct 30 07:53:13.267884 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:53:13.267831    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5\": container with ID starting with e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5 not found: ID does not exist" containerID="e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5"
Oct 30 07:53:13.267946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.267873    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5"} err="failed to get container status \"e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5\": rpc error: code = NotFound desc = could not find container \"e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5\": container with ID starting with e8c8216bba2f0b1a87ad4665314ab631d6099001fa814321a5b30ff19a47edd5 not found: ID does not exist"
Oct 30 07:53:13.313248 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.313224    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"]
Oct 30 07:53:13.319541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.319519    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8fef73-5b74b7b67f-m8cns"]
Oct 30 07:53:13.425361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:13.425275    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" path="/var/lib/kubelet/pods/b1c2ebbb-2d28-413d-9f48-ea7164c7fb08/volumes"
Oct 30 07:53:13.924688 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:53:13.924653    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:53:15.854346 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.854302    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"]
Oct 30 07:53:15.855268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.855245    5073 cpu_manager.go:414] "containerMap: removing container" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy"
Oct 30 07:53:15.855268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.855268    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy"
Oct 30 07:53:15.855456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.855324    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" containerName="maas-api"
Oct 30 07:53:15.855456 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.855333    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" containerName="maas-api"
Oct 30 07:53:15.855559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.855537    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="83f1aa75-34b6-47b8-819a-432113cdd7e4" containerName="istio-proxy"
Oct 30 07:53:15.855613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.855558    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1c2ebbb-2d28-413d-9f48-ea7164c7fb08" containerName="maas-api"
Oct 30 07:53:15.860714 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.860692    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.898580 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.898545    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"]
Oct 30 07:53:15.921314 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921265    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921488 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921391    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921585    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921624    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkhdp\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921693    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921747 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921725    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921764    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.921878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921837    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:15.922001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:15.921956    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023108 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023074    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023198    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023218    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkhdp\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023263    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023303 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023290    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023316    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023373    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023461    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023540 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023508    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023576    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023815 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023761    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023811    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.023887 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.023827    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.024198 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.024176    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.025743 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.025717    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.025962 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.025944    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.052248 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.052222    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.052376 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.052242    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkhdp\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp\") pod \"maas-default-gateway-openshift-default-6dcf757899-xjwvj\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.175638 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.175598    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:16.498442 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:53:16.498411    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898ba0e4_859d_48be_bf3c_d48b71602aeb.slice/crio-9bb8e800d442b77af40b05ec96616504857e92af2c93bc631657a0d70dffba74 WatchSource:0}: Error finding container 9bb8e800d442b77af40b05ec96616504857e92af2c93bc631657a0d70dffba74: Status 404 returned error can't find the container with id 9bb8e800d442b77af40b05ec96616504857e92af2c93bc631657a0d70dffba74
Oct 30 07:53:16.500244 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.500216    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"]
Oct 30 07:53:16.501933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.501901    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:53:16.502015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.501967    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:53:16.502015 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:16.501997    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:53:17.309086 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:17.309039    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" event={"ID":"898ba0e4-859d-48be-bf3c-d48b71602aeb","Type":"ContainerStarted","Data":"e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2"}
Oct 30 07:53:17.309608 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:17.309156    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" event={"ID":"898ba0e4-859d-48be-bf3c-d48b71602aeb","Type":"ContainerStarted","Data":"9bb8e800d442b77af40b05ec96616504857e92af2c93bc631657a0d70dffba74"}
Oct 30 07:53:17.369896 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:17.369829    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podStartSLOduration=2.369813188 podStartE2EDuration="2.369813188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:53:17.368077225 +0000 UTC m=+3400.075957396" watchObservedRunningTime="2026-10-30 07:53:17.369813188 +0000 UTC m=+3400.077693357"
Oct 30 07:53:18.178876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:18.176211    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:18.207896 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:18.194865    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:18.207896 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:18.194937    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:19.191877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:19.191265    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:19.191877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:19.191344    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:20.182874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:20.182245    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:20.182874 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:20.182313    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:20.819889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:20.815686    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"]
Oct 30 07:53:20.819889 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:20.816149    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy" containerID="cri-o://fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89" gracePeriod=30
Oct 30 07:53:21.195320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:21.195283    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:21.195650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:21.195617    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:22.179283 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:22.179243    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:22.179928 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:22.179890    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:23.176587 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:23.176544    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:23.176771 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:23.176617    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:24.176255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:24.176218    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xjwvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused" start-of-body=
Oct 30 07:53:24.176653 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:24.176293    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.190:15021/healthz/ready\": dial tcp 10.132.0.190:15021: connect: connection refused"
Oct 30 07:53:25.360205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:25.360171    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:25.360721 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:25.360655    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:25.361467 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:25.361446    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 07:53:26.140941 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.140908    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:53:26.204118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.204083    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.204387 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.204368    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.204536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.204521    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.204788 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.204773    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.205005 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.204989    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.205153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.205138    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.205304 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.205291    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.205429 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.205416    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.205647 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.205633    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket\") pod \"4b33aa17-9248-442b-93c9-6ec92a35ec01\" (UID: \"4b33aa17-9248-442b-93c9-6ec92a35ec01\") "
Oct 30 07:53:26.206722 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.206698    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:53:26.208132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.208110    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:53:26.208935 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.208913    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:53:26.209123 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.209101    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:53:26.209369 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.209349    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:53:26.229677 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.229365    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:53:26.229917 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.229890    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:53:26.230091 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.230070    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:53:26.230321 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.230293    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm" pod "4b33aa17-9248-442b-93c9-6ec92a35ec01" (UID: "4b33aa17-9248-442b-93c9-6ec92a35ec01"). InnerVolumeSpecName "kube-api-access-6bvsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:53:26.308701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308659    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308701    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308717    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308730    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b33aa17-9248-442b-93c9-6ec92a35ec01-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308742    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308755    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bvsm\" (UniqueName: \"kubernetes.io/projected/4b33aa17-9248-442b-93c9-6ec92a35ec01-kube-api-access-6bvsm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308769    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308783    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.308927 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.308796    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b33aa17-9248-442b-93c9-6ec92a35ec01-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:53:26.387378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.387344    5073 generic.go:356] "Generic (PLEG): container finished" podID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerID="fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89" exitCode=0
Oct 30 07:53:26.387812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.387414    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"
Oct 30 07:53:26.387812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.387411    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" event={"ID":"4b33aa17-9248-442b-93c9-6ec92a35ec01","Type":"ContainerDied","Data":"fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89"}
Oct 30 07:53:26.387812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.387489    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm" event={"ID":"4b33aa17-9248-442b-93c9-6ec92a35ec01","Type":"ContainerDied","Data":"3934b87d6d787333e12f26b7ea39cde0b3a48a6f389957a5fd4e43c26ef2c81d"}
Oct 30 07:53:26.387812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.387523    5073 scope.go:122] "RemoveContainer" containerID="fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89"
Oct 30 07:53:26.399412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.399391    5073 scope.go:122] "RemoveContainer" containerID="73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"
Oct 30 07:53:26.411898 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.411834    5073 scope.go:122] "RemoveContainer" containerID="fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89"
Oct 30 07:53:26.412164 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:53:26.412144    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89\": container with ID starting with fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89 not found: ID does not exist" containerID="fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89"
Oct 30 07:53:26.412217 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.412173    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89"} err="failed to get container status \"fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89\": rpc error: code = NotFound desc = could not find container \"fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89\": container with ID starting with fd0e168cfc07d43606512f2a1d07cfd539d950266c3eaa0b4c88a550c4afde89 not found: ID does not exist"
Oct 30 07:53:26.412217 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.412192    5073 scope.go:122] "RemoveContainer" containerID="73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"
Oct 30 07:53:26.412460 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:53:26.412444    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494\": container with ID starting with 73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494 not found: ID does not exist" containerID="73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"
Oct 30 07:53:26.412504 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.412473    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494"} err="failed to get container status \"73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494\": rpc error: code = NotFound desc = could not find container \"73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494\": container with ID starting with 73b6204f8b6c9a959a9795c414fb0e8ec516ee2ff89082da2e478b0f7bcd1494 not found: ID does not exist"
Oct 30 07:53:26.439896 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.439868    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"]
Oct 30 07:53:26.445710 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:26.445685    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8fef73-openshift-default-8494c86c4f-9x6hm"]
Oct 30 07:53:27.425740 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:27.425700    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" path="/var/lib/kubelet/pods/4b33aa17-9248-442b-93c9-6ec92a35ec01/volumes"
Oct 30 07:53:30.897361 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.897324    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"]
Oct 30 07:53:30.898094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.898077    5073 cpu_manager.go:414] "containerMap: removing container" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy"
Oct 30 07:53:30.898094 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.898093    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy"
Oct 30 07:53:30.898239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.898139    5073 cpu_manager.go:414] "containerMap: removing container" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy"
Oct 30 07:53:30.898239 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.898144    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy"
Oct 30 07:53:30.898353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.898256    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy"
Oct 30 07:53:30.898353 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.898279    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b33aa17-9248-442b-93c9-6ec92a35ec01" containerName="istio-proxy"
Oct 30 07:53:30.903727 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.903707    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.941877 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.941813    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"]
Oct 30 07:53:30.980775 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.980735    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.980974 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.980802    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.980962    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981085 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.981035    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981160 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.981149    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981240 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.981221    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981278 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.981261    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981327 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.981313    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdv2\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:30.981364 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:30.981349    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083270 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083225    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083277    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083327    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdv2\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083465 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083378    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083667 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083532    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083667 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083580    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083667 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083618    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083679    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083695    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.083829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083812    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.084070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.083824    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.084070 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.084007    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.084187 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.084160    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.084484 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.084458    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.085982 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.085951    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.086355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.086333    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.127701 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.127666    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdv2\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.127933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.127679    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-679fd\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.246115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.246037    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:31.655637 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:53:31.655601    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b319eba_a57f_4c02_8363_d21fa255f4e2.slice/crio-d67bb40e56036ce7d0eac3267b22458b6cbbf09d322a7924e1db47f8069bc363 WatchSource:0}: Error finding container d67bb40e56036ce7d0eac3267b22458b6cbbf09d322a7924e1db47f8069bc363: Status 404 returned error can't find the container with id d67bb40e56036ce7d0eac3267b22458b6cbbf09d322a7924e1db47f8069bc363
Oct 30 07:53:31.658829 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.658793    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:53:31.658966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.658904    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:53:31.658966 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.658938    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:53:31.659043 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:31.658990    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"]
Oct 30 07:53:32.494875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:32.490973    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" event={"ID":"5b319eba-a57f-4c02-8363-d21fa255f4e2","Type":"ContainerStarted","Data":"803819e2cc06785781929866371e448d1750fadb46091d6334d54b6318826b4b"}
Oct 30 07:53:32.494875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:32.491051    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" event={"ID":"5b319eba-a57f-4c02-8363-d21fa255f4e2","Type":"ContainerStarted","Data":"d67bb40e56036ce7d0eac3267b22458b6cbbf09d322a7924e1db47f8069bc363"}
Oct 30 07:53:32.557200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:32.557142    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podStartSLOduration=2.55712752 podStartE2EDuration="2.55712752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:53:32.554751486 +0000 UTC m=+3415.262631656" watchObservedRunningTime="2026-10-30 07:53:32.55712752 +0000 UTC m=+3415.265007693"
Oct 30 07:53:33.249876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:33.249195    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:33.253886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:33.253310    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:33.253886 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:33.253368    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:34.246687 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:34.246645    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:34.247256 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:34.246708    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:35.247363 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:35.247325    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:35.247758 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:35.247387    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:36.246753 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:36.246716    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:36.246969 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:36.246780    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:37.246532 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:37.246495    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:37.246933 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:37.246587    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:38.250878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:38.249056    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:38.250878 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:38.249137    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:39.246945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:39.246817    5073 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-679fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused" start-of-body=
Oct 30 07:53:39.246945 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:39.246914    5073 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.191:15021/healthz/ready\": dial tcp 10.132.0.191:15021: connect: connection refused"
Oct 30 07:53:40.592875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:40.592302    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:40.593686 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:40.593659    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:40.594573 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:53:40.594548    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 07:53:43.923300 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:53:43.923255    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:54:13.931256 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:54:13.931220    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:54:23.134113 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.134030    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"]
Oct 30 07:54:23.134668 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.134322    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" podUID="b4f00301-e8a0-40fd-bebe-59294b066359" containerName="maas-api" containerID="cri-o://6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709" gracePeriod=30
Oct 30 07:54:23.637875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.630173    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:54:23.801930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.795384    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6\" (UniqueName: \"kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6\") pod \"b4f00301-e8a0-40fd-bebe-59294b066359\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") "
Oct 30 07:54:23.801930 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.795474    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca\") pod \"b4f00301-e8a0-40fd-bebe-59294b066359\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") "
Oct 30 07:54:23.805884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.803912    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs\") pod \"b4f00301-e8a0-40fd-bebe-59294b066359\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") "
Oct 30 07:54:23.805884 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.803997    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\") pod \"b4f00301-e8a0-40fd-bebe-59294b066359\" (UID: \"b4f00301-e8a0-40fd-bebe-59294b066359\") "
Oct 30 07:54:23.814923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.806696    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca" pod "b4f00301-e8a0-40fd-bebe-59294b066359" (UID: "b4f00301-e8a0-40fd-bebe-59294b066359"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:54:23.814923 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.813398    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls" pod "b4f00301-e8a0-40fd-bebe-59294b066359" (UID: "b4f00301-e8a0-40fd-bebe-59294b066359"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:54:23.838870 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.837085    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6" pod "b4f00301-e8a0-40fd-bebe-59294b066359" (UID: "b4f00301-e8a0-40fd-bebe-59294b066359"). InnerVolumeSpecName "kube-api-access-97fh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:54:23.847424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.847339    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs" pod "b4f00301-e8a0-40fd-bebe-59294b066359" (UID: "b4f00301-e8a0-40fd-bebe-59294b066359"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:54:23.906611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.906512    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:23.906611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.906547    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4f00301-e8a0-40fd-bebe-59294b066359-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:23.906611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.906562    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97fh6\" (UniqueName: \"kubernetes.io/projected/b4f00301-e8a0-40fd-bebe-59294b066359-kube-api-access-97fh6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:23.906611 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:23.906575    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4f00301-e8a0-40fd-bebe-59294b066359-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:24.086132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.086057    5073 generic.go:356] "Generic (PLEG): container finished" podID="b4f00301-e8a0-40fd-bebe-59294b066359" containerID="6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709" exitCode=0
Oct 30 07:54:24.086132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.086104    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"
Oct 30 07:54:24.086132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.086110    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" event={"ID":"b4f00301-e8a0-40fd-bebe-59294b066359","Type":"ContainerDied","Data":"6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709"}
Oct 30 07:54:24.086355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.086151    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz" event={"ID":"b4f00301-e8a0-40fd-bebe-59294b066359","Type":"ContainerDied","Data":"a77a69953fb464dbfdcf646d104bfcfae901c14a75bf9284da963dc9e83d0a54"}
Oct 30 07:54:24.086355 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.086173    5073 scope.go:122] "RemoveContainer" containerID="6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709"
Oct 30 07:54:24.098001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.097977    5073 scope.go:122] "RemoveContainer" containerID="6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709"
Oct 30 07:54:24.098282 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:54:24.098261    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709\": container with ID starting with 6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709 not found: ID does not exist" containerID="6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709"
Oct 30 07:54:24.098367 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.098288    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709"} err="failed to get container status \"6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709\": rpc error: code = NotFound desc = could not find container \"6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709\": container with ID starting with 6c7d1b5f41bd2d2d46d0f22bba5c7c0098b0efc511724e5a32d08b023cda4709 not found: ID does not exist"
Oct 30 07:54:24.229876 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.224165    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"]
Oct 30 07:54:24.256875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:24.248546    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f480c6-5df546984d-2s6bz"]
Oct 30 07:54:25.423689 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:25.423655    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4f00301-e8a0-40fd-bebe-59294b066359" path="/var/lib/kubelet/pods/b4f00301-e8a0-40fd-bebe-59294b066359/volumes"
Oct 30 07:54:31.489980 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:31.489937    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"]
Oct 30 07:54:31.490487 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:31.490185    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" containerID="cri-o://aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d" gracePeriod=30
Oct 30 07:54:34.227963 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:34.227913    5073 patch_prober.go:29] interesting pod/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:54:34.228617 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:34.228582    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:54:36.810047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.810014    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:54:36.848257 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848226    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848281    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848427 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848389    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848434    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848516    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848533    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:54:36.848631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848546    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848693    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848745 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848722    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848759    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:54:36.848880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848827    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy\") pod \"b36915b0-0dfd-4b72-855a-8572047c6dc5\" (UID: \"b36915b0-0dfd-4b72-855a-8572047c6dc5\") "
Oct 30 07:54:36.848880 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848833    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:54:36.849055 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.848978    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:54:36.849167 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.849142    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:54:36.849570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.849550    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.849665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.849573    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.849665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.849587    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.849665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.849599    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.849665 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.849613    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b36915b0-0dfd-4b72-855a-8572047c6dc5-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.850845 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.850822    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:54:36.851001 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.850974    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "kube-api-access-xb5fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:54:36.851104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.851066    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:54:36.851104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.851094    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo" pod "b36915b0-0dfd-4b72-855a-8572047c6dc5" (UID: "b36915b0-0dfd-4b72-855a-8572047c6dc5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:54:36.951564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.951532    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb5fm\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-kube-api-access-xb5fm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.951564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.951563    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.951564 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.951572    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:36.951805 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:36.951582    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b36915b0-0dfd-4b72-855a-8572047c6dc5-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:54:37.324955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.324914    5073 generic.go:356] "Generic (PLEG): container finished" podID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerID="aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d" exitCode=0
Oct 30 07:54:37.325164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.324978    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"
Oct 30 07:54:37.325164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.324989    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" event={"ID":"b36915b0-0dfd-4b72-855a-8572047c6dc5","Type":"ContainerDied","Data":"aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d"}
Oct 30 07:54:37.325164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.325073    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f" event={"ID":"b36915b0-0dfd-4b72-855a-8572047c6dc5","Type":"ContainerDied","Data":"b0312f36d7965fa7eb50b3c36c833d39d3dc2bf7655a059a8277a81604971340"}
Oct 30 07:54:37.325164 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.325102    5073 scope.go:122] "RemoveContainer" containerID="aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d"
Oct 30 07:54:37.340570 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.340549    5073 scope.go:122] "RemoveContainer" containerID="aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d"
Oct 30 07:54:37.340953 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:54:37.340928    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d\": container with ID starting with aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d not found: ID does not exist" containerID="aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d"
Oct 30 07:54:37.341038 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.340960    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d"} err="failed to get container status \"aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d\": rpc error: code = NotFound desc = could not find container \"aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d\": container with ID starting with aa448de50391fac1a49e863be77950d7cd3a6745e704467bd1c4e050ecd75d1d not found: ID does not exist"
Oct 30 07:54:37.380311 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.380275    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"]
Oct 30 07:54:37.390584 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.390552    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f480c6-openshift-default-6b76996fd7-sz58f"]
Oct 30 07:54:37.426623 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:54:37.426591    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" path="/var/lib/kubelet/pods/b36915b0-0dfd-4b72-855a-8572047c6dc5/volumes"
Oct 30 07:54:43.973770 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:54:43.973730    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:55:13.962371 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:55:13.962329    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:55:20.817275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:20.817227    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"]
Oct 30 07:55:20.818132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:20.817471    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" podUID="02abd2a2-25cc-4a42-98c5-e67073323f95" containerName="maas-api" containerID="cri-o://ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32" gracePeriod=30
Oct 30 07:55:21.270115 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.270082    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:55:21.356028 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.355933    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\") pod \"02abd2a2-25cc-4a42-98c5-e67073323f95\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") "
Oct 30 07:55:21.356202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.356045    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca\") pod \"02abd2a2-25cc-4a42-98c5-e67073323f95\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") "
Oct 30 07:55:21.356202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.356183    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2\" (UniqueName: \"kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2\") pod \"02abd2a2-25cc-4a42-98c5-e67073323f95\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") "
Oct 30 07:55:21.356337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.356219    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs\") pod \"02abd2a2-25cc-4a42-98c5-e67073323f95\" (UID: \"02abd2a2-25cc-4a42-98c5-e67073323f95\") "
Oct 30 07:55:21.356978 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.356947    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca" pod "02abd2a2-25cc-4a42-98c5-e67073323f95" (UID: "02abd2a2-25cc-4a42-98c5-e67073323f95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:55:21.359301 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.359270    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs" pod "02abd2a2-25cc-4a42-98c5-e67073323f95" (UID: "02abd2a2-25cc-4a42-98c5-e67073323f95"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:55:21.359567 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.359529    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2" pod "02abd2a2-25cc-4a42-98c5-e67073323f95" (UID: "02abd2a2-25cc-4a42-98c5-e67073323f95"). InnerVolumeSpecName "kube-api-access-f74g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:55:21.361497 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.361473    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls" pod "02abd2a2-25cc-4a42-98c5-e67073323f95" (UID: "02abd2a2-25cc-4a42-98c5-e67073323f95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:55:21.481050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.466669    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:21.481050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.466711    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02abd2a2-25cc-4a42-98c5-e67073323f95-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:21.481050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.466727    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f74g2\" (UniqueName: \"kubernetes.io/projected/02abd2a2-25cc-4a42-98c5-e67073323f95-kube-api-access-f74g2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:21.481050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.466742    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02abd2a2-25cc-4a42-98c5-e67073323f95-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:21.716619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.716582    5073 generic.go:356] "Generic (PLEG): container finished" podID="02abd2a2-25cc-4a42-98c5-e67073323f95" containerID="ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32" exitCode=0
Oct 30 07:55:21.716942 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.716719    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" event={"ID":"02abd2a2-25cc-4a42-98c5-e67073323f95","Type":"ContainerDied","Data":"ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32"}
Oct 30 07:55:21.717147 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.717127    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq" event={"ID":"02abd2a2-25cc-4a42-98c5-e67073323f95","Type":"ContainerDied","Data":"2fdb1c61894a3de3fbac92648258f10b5ec1f43c05bcc8c36dca0f66659264a8"}
Oct 30 07:55:21.717277 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.716790    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"
Oct 30 07:55:21.717445 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.717164    5073 scope.go:122] "RemoveContainer" containerID="ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32"
Oct 30 07:55:21.731194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.731164    5073 scope.go:122] "RemoveContainer" containerID="ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32"
Oct 30 07:55:21.731480 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:55:21.731457    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32\": container with ID starting with ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32 not found: ID does not exist" containerID="ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32"
Oct 30 07:55:21.731578 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.731486    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32"} err="failed to get container status \"ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32\": rpc error: code = NotFound desc = could not find container \"ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32\": container with ID starting with ef0b53b3ddf73d428852c02c87579f7655027607499e8c99c8257841ecc09f32 not found: ID does not exist"
Oct 30 07:55:21.828707 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.827758    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"]
Oct 30 07:55:21.836042 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:21.836011    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-91c8c2-5dd9f4c564-jmpgq"]
Oct 30 07:55:23.423976 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:23.423941    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02abd2a2-25cc-4a42-98c5-e67073323f95" path="/var/lib/kubelet/pods/02abd2a2-25cc-4a42-98c5-e67073323f95/volumes"
Oct 30 07:55:29.147485 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:29.147445    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"]
Oct 30 07:55:29.148339 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:29.147676    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy" containerID="cri-o://406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8" gracePeriod=30
Oct 30 07:55:34.455292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.455266    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:55:34.504235 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504206    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504268    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504296    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504313    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504354    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504393 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504381    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504457    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504561    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504676 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504592    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy\") pod \"b856fb82-455b-4e05-b77e-e1a061545b4e\" (UID: \"b856fb82-455b-4e05-b77e-e1a061545b4e\") "
Oct 30 07:55:34.504830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504660    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:55:34.504830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504702    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:55:34.504830 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504758    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:55:34.505031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504902    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:55:34.505031 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.504917    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:55:34.505383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.505342    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.505383 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.505369    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.505537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.505384    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b856fb82-455b-4e05-b77e-e1a061545b4e-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.505537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.505396    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.505537 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.505408    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.506820 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.506794    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "kube-api-access-wk4w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:55:34.507065 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.507046    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:55:34.507320 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.507300    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:55:34.507385 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.507332    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token" pod "b856fb82-455b-4e05-b77e-e1a061545b4e" (UID: "b856fb82-455b-4e05-b77e-e1a061545b4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:55:34.607004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.606971    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.607004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.607000    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.607004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.607012    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk4w5\" (UniqueName: \"kubernetes.io/projected/b856fb82-455b-4e05-b77e-e1a061545b4e-kube-api-access-wk4w5\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.607237 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.607021    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b856fb82-455b-4e05-b77e-e1a061545b4e-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:55:34.815161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.815079    5073 generic.go:356] "Generic (PLEG): container finished" podID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerID="406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8" exitCode=0
Oct 30 07:55:34.815161 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.815127    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"
Oct 30 07:55:34.815400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.815166    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" event={"ID":"b856fb82-455b-4e05-b77e-e1a061545b4e","Type":"ContainerDied","Data":"406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8"}
Oct 30 07:55:34.815400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.815234    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs" event={"ID":"b856fb82-455b-4e05-b77e-e1a061545b4e","Type":"ContainerDied","Data":"4d575adb83bfa7470a58391ebc4ac48c39b1d59bf35fd4b1dc3362cdd4a79be6"}
Oct 30 07:55:34.815400 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.815263    5073 scope.go:122] "RemoveContainer" containerID="406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8"
Oct 30 07:55:34.827609 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.827591    5073 scope.go:122] "RemoveContainer" containerID="2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"
Oct 30 07:55:34.837558 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.837540    5073 scope.go:122] "RemoveContainer" containerID="406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8"
Oct 30 07:55:34.837841 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:55:34.837818    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8\": container with ID starting with 406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8 not found: ID does not exist" containerID="406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8"
Oct 30 07:55:34.837946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.837866    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8"} err="failed to get container status \"406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8\": rpc error: code = NotFound desc = could not find container \"406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8\": container with ID starting with 406f6cef9cfc03d8e6570c96b74c9b887d89af2cf2c745c516a472c8d8159ba8 not found: ID does not exist"
Oct 30 07:55:34.837946 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.837891    5073 scope.go:122] "RemoveContainer" containerID="2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"
Oct 30 07:55:34.838169 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:55:34.838150    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f\": container with ID starting with 2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f not found: ID does not exist" containerID="2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"
Oct 30 07:55:34.838207 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.838176    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f"} err="failed to get container status \"2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f\": rpc error: code = NotFound desc = could not find container \"2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f\": container with ID starting with 2f0bd99a906bef801ceb36c20dca94ea5e8fb1cae156f14aaf8ab7a2f3a6ba8f not found: ID does not exist"
Oct 30 07:55:34.866756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.866733    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"]
Oct 30 07:55:34.873202 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:34.873181    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-91c8c2-openshift-default-796b674c75-xp2rs"]
Oct 30 07:55:35.423711 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:55:35.423673    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" path="/var/lib/kubelet/pods/b856fb82-455b-4e05-b77e-e1a061545b4e/volumes"
Oct 30 07:55:43.925317 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:55:43.925275    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:56:13.923113 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:56:13.923072    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:56:23.602566 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:23.602529    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"]
Oct 30 07:56:23.604619 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:23.604551    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" podUID="ff90b41a-5957-4fc6-8e58-d20c0dc71470" containerName="maas-api" containerID="cri-o://91b93120c10e0dff74803d3ea5cbb908ca02561fffed57291727ee555cad8920" gracePeriod=30
Oct 30 07:56:24.277948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.275871    5073 generic.go:356] "Generic (PLEG): container finished" podID="ff90b41a-5957-4fc6-8e58-d20c0dc71470" containerID="91b93120c10e0dff74803d3ea5cbb908ca02561fffed57291727ee555cad8920" exitCode=0
Oct 30 07:56:24.277948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.276121    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" event={"ID":"ff90b41a-5957-4fc6-8e58-d20c0dc71470","Type":"ContainerDied","Data":"91b93120c10e0dff74803d3ea5cbb908ca02561fffed57291727ee555cad8920"}
Oct 30 07:56:24.277948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.276179    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74" event={"ID":"ff90b41a-5957-4fc6-8e58-d20c0dc71470","Type":"ContainerDied","Data":"53d5b0035bf105d7a506c2f65b5919afbadf199c1cdb7da9aba53223cc967f0a"}
Oct 30 07:56:24.277948 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.276202    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53d5b0035bf105d7a506c2f65b5919afbadf199c1cdb7da9aba53223cc967f0a"
Oct 30 07:56:24.282172 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.282110    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:56:24.300300 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.300270    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\") pod \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") "
Oct 30 07:56:24.300458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.300319    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn\" (UniqueName: \"kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn\") pod \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") "
Oct 30 07:56:24.300458 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.300438    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca\") pod \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") "
Oct 30 07:56:24.300602 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.300461    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs\") pod \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\" (UID: \"ff90b41a-5957-4fc6-8e58-d20c0dc71470\") "
Oct 30 07:56:24.301054 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.301025    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca" pod "ff90b41a-5957-4fc6-8e58-d20c0dc71470" (UID: "ff90b41a-5957-4fc6-8e58-d20c0dc71470"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:56:24.302922 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.302895    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls" pod "ff90b41a-5957-4fc6-8e58-d20c0dc71470" (UID: "ff90b41a-5957-4fc6-8e58-d20c0dc71470"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:56:24.303011 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.302971    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs" pod "ff90b41a-5957-4fc6-8e58-d20c0dc71470" (UID: "ff90b41a-5957-4fc6-8e58-d20c0dc71470"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:56:24.304289 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.304270    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn" pod "ff90b41a-5957-4fc6-8e58-d20c0dc71470" (UID: "ff90b41a-5957-4fc6-8e58-d20c0dc71470"). InnerVolumeSpecName "kube-api-access-vv4tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:56:24.402891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.402806    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:56:24.402891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.402882    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv4tn\" (UniqueName: \"kubernetes.io/projected/ff90b41a-5957-4fc6-8e58-d20c0dc71470-kube-api-access-vv4tn\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:56:24.402891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.402894    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff90b41a-5957-4fc6-8e58-d20c0dc71470-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:56:24.402891 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:24.402904    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff90b41a-5957-4fc6-8e58-d20c0dc71470-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:56:25.286004 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:25.285964    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"
Oct 30 07:56:25.352511 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:25.352478    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"]
Oct 30 07:56:25.364104 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:25.364076    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0e9723-68f7444f88-qjq74"]
Oct 30 07:56:25.425477 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:25.425443    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff90b41a-5957-4fc6-8e58-d20c0dc71470" path="/var/lib/kubelet/pods/ff90b41a-5957-4fc6-8e58-d20c0dc71470/volumes"
Oct 30 07:56:39.035909 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:39.035874    5073 scope.go:122] "RemoveContainer" containerID="91b93120c10e0dff74803d3ea5cbb908ca02561fffed57291727ee555cad8920"
Oct 30 07:56:39.587032 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:39.586999    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:56:39.587333 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:56:39.587312    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 07:56:43.928907 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:56:43.928865    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:57:13.922157 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:57:13.922113    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:57:25.354594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.354439    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"]
Oct 30 07:57:25.355097 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.354668    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" podUID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" containerName="discovery" containerID="cri-o://171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f" gracePeriod=30
Oct 30 07:57:25.710650 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.710623    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:57:25.824365 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824326    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824408    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824543    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824594 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824585    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824717 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824702    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824772 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824755    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824818 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824796    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig\") pod \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\" (UID: \"5cebc3d8-995a-4153-b10b-a953f8fbdd30\") "
Oct 30 07:57:25.824883 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.824834    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:57:25.825568 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.825539    5073 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-ca-configmap\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:25.827541 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.827512    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:57:25.827662 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.827542    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "kube-api-access-dcghl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:57:25.827662 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.827574    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:57:25.828375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.828334    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:57:25.828375 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.828345    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:57:25.828514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.828410    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig" pod "5cebc3d8-995a-4153-b10b-a953f8fbdd30" (UID: "5cebc3d8-995a-4153-b10b-a953f8fbdd30"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:57:25.927200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.927121    5073 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-csr-dns-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:25.927200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.927151    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcghl\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-kube-api-access-dcghl\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:25.927200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.927161    5073 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-kubeconfig\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:25.927200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.927170    5073 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cebc3d8-995a-4153-b10b-a953f8fbdd30-cacerts\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:25.927200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.927178    5073 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cebc3d8-995a-4153-b10b-a953f8fbdd30-local-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:25.927200 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:25.927185    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cebc3d8-995a-4153-b10b-a953f8fbdd30-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:26.136221 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.136185    5073 generic.go:356] "Generic (PLEG): container finished" podID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" containerID="171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f" exitCode=0
Oct 30 07:57:26.136412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.136239    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"
Oct 30 07:57:26.136412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.136277    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" event={"ID":"5cebc3d8-995a-4153-b10b-a953f8fbdd30","Type":"ContainerDied","Data":"171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f"}
Oct 30 07:57:26.136412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.136380    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29" event={"ID":"5cebc3d8-995a-4153-b10b-a953f8fbdd30","Type":"ContainerDied","Data":"a6cd3efcd6ded19589b1acfc6506617342fa408561d3a7a39128d49b2bcd0749"}
Oct 30 07:57:26.136412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.136408    5073 scope.go:122] "RemoveContainer" containerID="171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f"
Oct 30 07:57:26.152698 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.152674    5073 scope.go:122] "RemoveContainer" containerID="171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f"
Oct 30 07:57:26.153031 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:57:26.153006    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f\": container with ID starting with 171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f not found: ID does not exist" containerID="171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f"
Oct 30 07:57:26.153103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.153041    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f"} err="failed to get container status \"171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f\": rpc error: code = NotFound desc = could not find container \"171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f\": container with ID starting with 171239a30851134d5dc95fbe42fd7c65c47b122a7f957e7d6b314e5c0722900f not found: ID does not exist"
Oct 30 07:57:26.188524 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.188429    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"]
Oct 30 07:57:26.199335 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.199303    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-84r29"]
Oct 30 07:57:26.215209 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.215175    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"]
Oct 30 07:57:26.215389 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.215363    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" podUID="2c3aac55-3105-4043-bb96-1bf559a5b8e2" containerName="maas-api" containerID="cri-o://c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd" gracePeriod=30
Oct 30 07:57:26.594337 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.593827    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:57:26.754943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.752927    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r\" (UniqueName: \"kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r\") pod \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") "
Oct 30 07:57:26.754943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.752988    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\") pod \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") "
Oct 30 07:57:26.754943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.753124    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs\") pod \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") "
Oct 30 07:57:26.754943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.753180    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca\") pod \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\" (UID: \"2c3aac55-3105-4043-bb96-1bf559a5b8e2\") "
Oct 30 07:57:26.754943 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.754381    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca" pod "2c3aac55-3105-4043-bb96-1bf559a5b8e2" (UID: "2c3aac55-3105-4043-bb96-1bf559a5b8e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:57:26.835885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.822588    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls" pod "2c3aac55-3105-4043-bb96-1bf559a5b8e2" (UID: "2c3aac55-3105-4043-bb96-1bf559a5b8e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:57:26.835885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.823106    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r" pod "2c3aac55-3105-4043-bb96-1bf559a5b8e2" (UID: "2c3aac55-3105-4043-bb96-1bf559a5b8e2"). InnerVolumeSpecName "kube-api-access-5ps2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:57:26.835885 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.823266    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs" pod "2c3aac55-3105-4043-bb96-1bf559a5b8e2" (UID: "2c3aac55-3105-4043-bb96-1bf559a5b8e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:57:26.855317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.855272    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ps2r\" (UniqueName: \"kubernetes.io/projected/2c3aac55-3105-4043-bb96-1bf559a5b8e2-kube-api-access-5ps2r\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:26.855317 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.855314    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:26.855514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.855329    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c3aac55-3105-4043-bb96-1bf559a5b8e2-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:26.855514 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:26.855344    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3aac55-3105-4043-bb96-1bf559a5b8e2-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:27.144260 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.144230    5073 generic.go:356] "Generic (PLEG): container finished" podID="2c3aac55-3105-4043-bb96-1bf559a5b8e2" containerID="c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd" exitCode=0
Oct 30 07:57:27.144451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.144289    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"
Oct 30 07:57:27.144451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.144318    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" event={"ID":"2c3aac55-3105-4043-bb96-1bf559a5b8e2","Type":"ContainerDied","Data":"c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd"}
Oct 30 07:57:27.144451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.144383    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742" event={"ID":"2c3aac55-3105-4043-bb96-1bf559a5b8e2","Type":"ContainerDied","Data":"7f9dfba1337100c8abf925e6dc286ae1f11d7b0c4d283706a9290352dfcafd4a"}
Oct 30 07:57:27.144451 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.144408    5073 scope.go:122] "RemoveContainer" containerID="c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd"
Oct 30 07:57:27.158147 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.158124    5073 scope.go:122] "RemoveContainer" containerID="c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd"
Oct 30 07:57:27.158464 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:57:27.158433    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd\": container with ID starting with c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd not found: ID does not exist" containerID="c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd"
Oct 30 07:57:27.158601 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.158471    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd"} err="failed to get container status \"c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd\": rpc error: code = NotFound desc = could not find container \"c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd\": container with ID starting with c97da5486e6d33a631200599405879336a1a9b3d906a4b77be42595986d42ddd not found: ID does not exist"
Oct 30 07:57:27.198243 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.198202    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"]
Oct 30 07:57:27.204510 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.204473    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8514a3-5fbf5645b5-vl742"]
Oct 30 07:57:27.424735 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.424701    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c3aac55-3105-4043-bb96-1bf559a5b8e2" path="/var/lib/kubelet/pods/2c3aac55-3105-4043-bb96-1bf559a5b8e2/volumes"
Oct 30 07:57:27.425245 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:27.425230    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" path="/var/lib/kubelet/pods/5cebc3d8-995a-4153-b10b-a953f8fbdd30/volumes"
Oct 30 07:57:34.725664 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:34.725625    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"]
Oct 30 07:57:34.726219 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:34.725882    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy" containerID="cri-o://64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b" gracePeriod=30
Oct 30 07:57:40.154700 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.154672    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:57:40.316357 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316262    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.316357 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316301    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.316357 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316345    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.316734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316625    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.316734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316621    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:57:40.316734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316665    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.316734 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316697    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.317044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316759    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.317044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316797    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.317044 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.316831    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket\") pod \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\" (UID: \"921fd42f-42c8-455c-a89b-3ad9ffe0a673\") "
Oct 30 07:57:40.317212 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317050    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:57:40.317331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317311    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:57:40.317518 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317489    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:57:40.317641 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317624    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.317723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317645    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.317723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317659    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.317723 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.317675    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.318082 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.318050    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:57:40.320370 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.320337    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 07:57:40.320476 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.320447    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:57:40.321114 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.321090    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 07:57:40.322033 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.322004    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f" pod "921fd42f-42c8-455c-a89b-3ad9ffe0a673" (UID: "921fd42f-42c8-455c-a89b-3ad9ffe0a673"). InnerVolumeSpecName "kube-api-access-d7z6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:57:40.341725 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.341700    5073 generic.go:356] "Generic (PLEG): container finished" podID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerID="64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b" exitCode=0
Oct 30 07:57:40.341940 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.341920    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" event={"ID":"921fd42f-42c8-455c-a89b-3ad9ffe0a673","Type":"ContainerDied","Data":"64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b"}
Oct 30 07:57:40.342040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.341979    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5" event={"ID":"921fd42f-42c8-455c-a89b-3ad9ffe0a673","Type":"ContainerDied","Data":"f6c9f58a0aeb0ca313461d872ae0fc85ea682fe653d2e60fe300fb1c7459f512"}
Oct 30 07:57:40.342040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.342013    5073 scope.go:122] "RemoveContainer" containerID="64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b"
Oct 30 07:57:40.342184 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.342170    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"
Oct 30 07:57:40.371444 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.371412    5073 scope.go:122] "RemoveContainer" containerID="e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"
Oct 30 07:57:40.393957 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.393928    5073 scope.go:122] "RemoveContainer" containerID="64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b"
Oct 30 07:57:40.394345 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:57:40.394320    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b\": container with ID starting with 64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b not found: ID does not exist" containerID="64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b"
Oct 30 07:57:40.394464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.394359    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b"} err="failed to get container status \"64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b\": rpc error: code = NotFound desc = could not find container \"64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b\": container with ID starting with 64cb96cae89f6515e37fbd8b51192d8687873a9fbf3b214cb128fa553741df0b not found: ID does not exist"
Oct 30 07:57:40.394464 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.394382    5073 scope.go:122] "RemoveContainer" containerID="e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"
Oct 30 07:57:40.394790 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:57:40.394752    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d\": container with ID starting with e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d not found: ID does not exist" containerID="e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"
Oct 30 07:57:40.394950 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.394789    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d"} err="failed to get container status \"e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d\": rpc error: code = NotFound desc = could not find container \"e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d\": container with ID starting with e40fa440eb323fa1a23466b047f2c7f832ebba1c84b467d6c9bed434d7999d4d not found: ID does not exist"
Oct 30 07:57:40.415482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.415065    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"]
Oct 30 07:57:40.415482 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.415121    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8514a3-openshift-default-7d9478d49c-rk8l5"]
Oct 30 07:57:40.421900 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.421869    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7z6f\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-kube-api-access-d7z6f\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.422103 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.422075    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.422194 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.422183    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.422291 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.422280    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/921fd42f-42c8-455c-a89b-3ad9ffe0a673-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:40.422381 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:40.422363    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/921fd42f-42c8-455c-a89b-3ad9ffe0a673-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:57:41.425139 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:41.425108    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" path="/var/lib/kubelet/pods/921fd42f-42c8-455c-a89b-3ad9ffe0a673/volumes"
Oct 30 07:57:43.925126 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:57:43.925088    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:57:44.186153 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.186064    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"]
Oct 30 07:57:44.186964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.186937    5073 cpu_manager.go:414] "containerMap: removing container" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy"
Oct 30 07:57:44.186964 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.186959    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.186992    5073 cpu_manager.go:414] "containerMap: removing container" podUID="02abd2a2-25cc-4a42-98c5-e67073323f95" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187000    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02abd2a2-25cc-4a42-98c5-e67073323f95" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187010    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b4f00301-e8a0-40fd-bebe-59294b066359" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187018    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4f00301-e8a0-40fd-bebe-59294b066359" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187055    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" containerName="discovery"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187063    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" containerName="discovery"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187079    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187085    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187110    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ff90b41a-5957-4fc6-8e58-d20c0dc71470" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187117    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff90b41a-5957-4fc6-8e58-d20c0dc71470" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187140    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187147    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187162    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2c3aac55-3105-4043-bb96-1bf559a5b8e2" containerName="maas-api"
Oct 30 07:57:44.187178 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187170    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c3aac55-3105-4043-bb96-1bf559a5b8e2" containerName="maas-api"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187338    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff90b41a-5957-4fc6-8e58-d20c0dc71470" containerName="maas-api"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187354    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187366    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b36915b0-0dfd-4b72-855a-8572047c6dc5" containerName="istio-proxy"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187378    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187386    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c3aac55-3105-4043-bb96-1bf559a5b8e2" containerName="maas-api"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187399    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187413    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="02abd2a2-25cc-4a42-98c5-e67073323f95" containerName="maas-api"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187421    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4f00301-e8a0-40fd-bebe-59294b066359" containerName="maas-api"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187433    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cebc3d8-995a-4153-b10b-a953f8fbdd30" containerName="discovery"
Oct 30 07:57:44.187903 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.187445    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy"
Oct 30 07:57:44.191944 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.191899    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.217892 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.217833    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w0-bd8589\"/\"sub-test-model-bd8589-kserve-self-signed-certs\""
Oct 30 07:57:44.218040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.217833    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w0-bd8589\"/\"default-dockercfg-fd269\""
Oct 30 07:57:44.218040 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.217928    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w0-bd8589\"/\"openshift-service-ca.crt\""
Oct 30 07:57:44.218169 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.218042    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w0-bd8589\"/\"kube-root-ca.crt\""
Oct 30 07:57:44.225289 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.225264    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"]
Oct 30 07:57:44.378559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.378516    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.378559 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.378555    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.378814 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.378714    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.378939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.378882    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.379016 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.378948    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwjv\" (UniqueName: \"kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.379158 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.379030    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.479939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.479825    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.479939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.479935    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwjv\" (UniqueName: \"kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.479972    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.480004    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.480021    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480183 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.480138    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480412 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.480341    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480463 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.480430    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.480504 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.480480    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.482424 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.482395    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.482681 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.482665    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.503047 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.503020    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwjv\" (UniqueName: \"kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv\") pod \"sub-test-model-bd8589-kserve-54cc456b9-tm6qf\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") " pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.513388 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.513089    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:44.838357 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:44.838271    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"]
Oct 30 07:57:44.839073 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:57:44.839031    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9d19ace_9eac_41c4_b167_d496d4ca74b8.slice/crio-6c8b8528b3609f64225425d871076c85fce1a40e9f13b46e459bf612292355b0 WatchSource:0}: Error finding container 6c8b8528b3609f64225425d871076c85fce1a40e9f13b46e459bf612292355b0: Status 404 returned error can't find the container with id 6c8b8528b3609f64225425d871076c85fce1a40e9f13b46e459bf612292355b0
Oct 30 07:57:45.409415 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:45.409368    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" event={"ID":"e9d19ace-9eac-41c4-b167-d496d4ca74b8","Type":"ContainerStarted","Data":"3e47f689ffdc0c01c61023b500a8764de372669dc5a5f72ab8489fd43eb04e26"}
Oct 30 07:57:45.410139 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:45.410116    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" event={"ID":"e9d19ace-9eac-41c4-b167-d496d4ca74b8","Type":"ContainerStarted","Data":"6c8b8528b3609f64225425d871076c85fce1a40e9f13b46e459bf612292355b0"}
Oct 30 07:57:45.450704 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:45.450654    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" podStartSLOduration=1.450642647 podStartE2EDuration="1.450642647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:57:45.448813645 +0000 UTC m=+3668.156693815" watchObservedRunningTime="2026-10-30 07:57:45.450642647 +0000 UTC m=+3668.158522816"
Oct 30 07:57:45.514021 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:45.513992    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:54.514292 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:54.514258    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:54.527939 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:54.527914    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:55.478151 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.478115    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"]
Oct 30 07:57:55.479191 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.479170    5073 cpu_manager.go:414] "containerMap: removing container" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy"
Oct 30 07:57:55.479259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.479194    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="921fd42f-42c8-455c-a89b-3ad9ffe0a673" containerName="istio-proxy"
Oct 30 07:57:55.479259 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.479253    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy"
Oct 30 07:57:55.479331 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.479261    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b856fb82-455b-4e05-b77e-e1a061545b4e" containerName="istio-proxy"
Oct 30 07:57:55.484132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.484107    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.493118 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.493093    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 07:57:55.505616 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.505582    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"]
Oct 30 07:57:55.521875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.520213    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 07:57:55.521875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.520261    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 07:57:55.521875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.520387    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 07:57:55.521875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.520219    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xjg2r\""
Oct 30 07:57:55.662906 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.662870    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4cl6\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.663106 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.663059    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.663182 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.663113    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.663347 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.663321    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.663396 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.663373    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.663536 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.663520    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.663631 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.663616    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765127    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765205 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765181    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4cl6\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765279    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765326    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765428 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765402    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765613 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765522    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.765728 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.765664    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.766290 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.766261    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.767812 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.767766    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.767934 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.767899    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.768062 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.768043    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.768132 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.768089    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.802756 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.802723    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4cl6\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:55.835117 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:55.835091    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-qftw9\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:56.102679 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:56.102586    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:56.460890 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:56.460846    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"]
Oct 30 07:57:56.461321 ip-10-0-132-33 kubenswrapper[5073]: W1030 07:57:56.461301    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0222c657_c49a_438d_8ce0_31510447bd8f.slice/crio-8e2f07a5650f1e30900d0a5a05cb01d10848cf59f188bc52255a77382a9d2442 WatchSource:0}: Error finding container 8e2f07a5650f1e30900d0a5a05cb01d10848cf59f188bc52255a77382a9d2442: Status 404 returned error can't find the container with id 8e2f07a5650f1e30900d0a5a05cb01d10848cf59f188bc52255a77382a9d2442
Oct 30 07:57:56.463984 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:56.463954    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:57:56.464057 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:56.464014    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 07:57:56.490628 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:56.490594    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" event={"ID":"0222c657-c49a-438d-8ce0-31510447bd8f","Type":"ContainerStarted","Data":"8e2f07a5650f1e30900d0a5a05cb01d10848cf59f188bc52255a77382a9d2442"}
Oct 30 07:57:57.506490 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:57.506444    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" event={"ID":"0222c657-c49a-438d-8ce0-31510447bd8f","Type":"ContainerStarted","Data":"dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd"}
Oct 30 07:57:57.507091 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:57.506959    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:57:57.508879 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:57.508841    5073 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-qftw9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 07:57:57.509050 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:57.509028    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" podUID="0222c657-c49a-438d-8ce0-31510447bd8f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 07:57:57.581873 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:57.581587    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" podStartSLOduration=2.581564974 podStartE2EDuration="2.581564974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 07:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 07:57:57.56140158 +0000 UTC m=+3680.269281750" watchObservedRunningTime="2026-10-30 07:57:57.581564974 +0000 UTC m=+3680.289445144"
Oct 30 07:57:58.515839 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:57:58.515809    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 07:58:13.927249 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:58:13.927198    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:58:34.520733 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.520693    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"]
Oct 30 07:58:34.521255 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.520907    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn" podUID="f0813c1d-44db-45c6-a7b5-93c859d863b6" containerName="maas-api" containerID="cri-o://167cb4498f3ec74c095a0673d5372092c7c3013df4bdf8384270e8599fd8ecee" gracePeriod=30
Oct 30 07:58:34.902378 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.902347    5073 generic.go:356] "Generic (PLEG): container finished" podID="f0813c1d-44db-45c6-a7b5-93c859d863b6" containerID="167cb4498f3ec74c095a0673d5372092c7c3013df4bdf8384270e8599fd8ecee" exitCode=0
Oct 30 07:58:34.902538 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.902394    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn" event={"ID":"f0813c1d-44db-45c6-a7b5-93c859d863b6","Type":"ContainerDied","Data":"167cb4498f3ec74c095a0673d5372092c7c3013df4bdf8384270e8599fd8ecee"}
Oct 30 07:58:34.913186 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.913051    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:58:34.965133 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.965104    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca\") pod \"f0813c1d-44db-45c6-a7b5-93c859d863b6\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") "
Oct 30 07:58:34.965268 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.965155    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs\") pod \"f0813c1d-44db-45c6-a7b5-93c859d863b6\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") "
Oct 30 07:58:34.965322 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.965280    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4\" (UniqueName: \"kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4\") pod \"f0813c1d-44db-45c6-a7b5-93c859d863b6\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") "
Oct 30 07:58:34.965522 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.965496    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca" pod "f0813c1d-44db-45c6-a7b5-93c859d863b6" (UID: "f0813c1d-44db-45c6-a7b5-93c859d863b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 07:58:34.966134 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.966110    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0813c1d-44db-45c6-a7b5-93c859d863b6-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:58:34.967391 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.967369    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs" pod "f0813c1d-44db-45c6-a7b5-93c859d863b6" (UID: "f0813c1d-44db-45c6-a7b5-93c859d863b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:58:34.967572 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:34.967552    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4" pod "f0813c1d-44db-45c6-a7b5-93c859d863b6" (UID: "f0813c1d-44db-45c6-a7b5-93c859d863b6"). InnerVolumeSpecName "kube-api-access-t49r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 07:58:35.066642 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.066610    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls\") pod \"f0813c1d-44db-45c6-a7b5-93c859d863b6\" (UID: \"f0813c1d-44db-45c6-a7b5-93c859d863b6\") "
Oct 30 07:58:35.067210 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.067189    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:58:35.067334 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.067213    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t49r4\" (UniqueName: \"kubernetes.io/projected/f0813c1d-44db-45c6-a7b5-93c859d863b6-kube-api-access-t49r4\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:58:35.069022 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.068996    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls" pod "f0813c1d-44db-45c6-a7b5-93c859d863b6" (UID: "f0813c1d-44db-45c6-a7b5-93c859d863b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 07:58:35.170955 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.170529    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0813c1d-44db-45c6-a7b5-93c859d863b6-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 07:58:35.914752 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.914707    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn" event={"ID":"f0813c1d-44db-45c6-a7b5-93c859d863b6","Type":"ContainerDied","Data":"9d392138d0f917fff7966196ea0bf2e3962bc66e0651880b63f0399fdf46ca09"}
Oct 30 07:58:35.915275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.914720    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"
Oct 30 07:58:35.915275 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:35.914789    5073 scope.go:122] "RemoveContainer" containerID="167cb4498f3ec74c095a0673d5372092c7c3013df4bdf8384270e8599fd8ecee"
Oct 30 07:58:36.009937 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:36.009900    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"]
Oct 30 07:58:36.045875 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:36.044302    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-896ca4-7f948f75db-bnwwn"]
Oct 30 07:58:37.424336 ip-10-0-132-33 kubenswrapper[5073]: I1030 07:58:37.424305    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0813c1d-44db-45c6-a7b5-93c859d863b6" path="/var/lib/kubelet/pods/f0813c1d-44db-45c6-a7b5-93c859d863b6/volumes"
Oct 30 07:58:44.080875 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:58:44.080690    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:59:13.923665 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:59:13.923581    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 07:59:43.923742 ip-10-0-132-33 kubenswrapper[5073]: E1030 07:59:43.923699    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:00:00.396935 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.396892    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"]
Oct 30 08:00:00.397991 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.397970    5073 cpu_manager.go:414] "containerMap: removing container" podUID="f0813c1d-44db-45c6-a7b5-93c859d863b6" containerName="maas-api"
Oct 30 08:00:00.398084 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.397992    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0813c1d-44db-45c6-a7b5-93c859d863b6" containerName="maas-api"
Oct 30 08:00:00.398210 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.398198    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0813c1d-44db-45c6-a7b5-93c859d863b6" containerName="maas-api"
Oct 30 08:00:00.402299 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.402276    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.435690 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.435658    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9pb7\""
Oct 30 08:00:00.440826 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.440785    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbjbm\" (UniqueName: \"kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm\") pod \"maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.441099 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.441074    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.451005 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.450970    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"]
Oct 30 08:00:00.456085 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.456057    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.456300 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.456274    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"]
Oct 30 08:00:00.497670 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.497642    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"]
Oct 30 08:00:00.502801 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.502773    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.515712 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.515683    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"]
Oct 30 08:00:00.523264 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.523226    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"]
Oct 30 08:00:00.542510 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.542474    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.542750 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.542729    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6h2n\" (UniqueName: \"kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.542917 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.542773    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.542989 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.542957    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsm6\" (UniqueName: \"kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6\") pod \"maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.543043 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.542993    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbjbm\" (UniqueName: \"kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm\") pod \"maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.543408 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.543385    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.543500 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.543456    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.569833 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.569798    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbjbm\" (UniqueName: \"kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm\") pod \"maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.644207 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.644175    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.644423 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.644221    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6h2n\" (UniqueName: \"kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.644423 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.644333    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsm6\" (UniqueName: \"kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6\") pod \"maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.644423 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.644397    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.644949 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.644809    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.645102 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.645085    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.669663 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.669591    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsm6\" (UniqueName: \"kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6\") pod \"maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:00.669798 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.669744    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6h2n\" (UniqueName: \"kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n\") pod \"maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.717505 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.717472    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:00.773595 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.773556    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:00.831146 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:00.831110    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:01.026085 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:00:01.025915    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbdbbf4_f026_4db8_90fc_026829ded1af.slice/crio-1229fc11b25cddf380135958d0b6f2f76247c5943eb5b663549a4ed975bbcdb1 WatchSource:0}: Error finding container 1229fc11b25cddf380135958d0b6f2f76247c5943eb5b663549a4ed975bbcdb1: Status 404 returned error can't find the container with id 1229fc11b25cddf380135958d0b6f2f76247c5943eb5b663549a4ed975bbcdb1
Oct 30 08:00:01.026498 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.026322    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"]
Oct 30 08:00:01.113497 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:00:01.113468    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfdf133_238b_40f6_ac16_5edd894148a8.slice/crio-2e380c45f89f9fd145570e71910201fae8cfe02f9a7fbfa5518b425f294808fd WatchSource:0}: Error finding container 2e380c45f89f9fd145570e71910201fae8cfe02f9a7fbfa5518b425f294808fd: Status 404 returned error can't find the container with id 2e380c45f89f9fd145570e71910201fae8cfe02f9a7fbfa5518b425f294808fd
Oct 30 08:00:01.114027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.114000    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"]
Oct 30 08:00:01.182934 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:00:01.182812    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5741efea_b1a0_4c80_9eeb_1f16d857f872.slice/crio-5b8d963d5716bbe252243b4aee733bbc6e9614bf0d627ccbc4ba53ebcbbb7ace WatchSource:0}: Error finding container 5b8d963d5716bbe252243b4aee733bbc6e9614bf0d627ccbc4ba53ebcbbb7ace: Status 404 returned error can't find the container with id 5b8d963d5716bbe252243b4aee733bbc6e9614bf0d627ccbc4ba53ebcbbb7ace
Oct 30 08:00:01.183823 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.183798    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"]
Oct 30 08:00:01.719175 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.719132    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerStarted","Data":"692369ce156e9c7e90f0c80a5181abdc44ed7ad9ba2375b9981b7dfecf5d7d3d"}
Oct 30 08:00:01.719666 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.719208    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerStarted","Data":"1229fc11b25cddf380135958d0b6f2f76247c5943eb5b663549a4ed975bbcdb1"}
Oct 30 08:00:01.722349 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.721740    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerStarted","Data":"a3ee212a198a5f7ee3a2d4f715bb17889cb6611b0efaf625f1043a1cd4942d02"}
Oct 30 08:00:01.722349 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.721810    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerStarted","Data":"2e380c45f89f9fd145570e71910201fae8cfe02f9a7fbfa5518b425f294808fd"}
Oct 30 08:00:01.727528 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.727503    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerStarted","Data":"430914d8c5e6d4b1b46216bc318f9dd6a7d773c15de6f41601740cb93532969a"}
Oct 30 08:00:01.727671 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.727545    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerStarted","Data":"5b8d963d5716bbe252243b4aee733bbc6e9614bf0d627ccbc4ba53ebcbbb7ace"}
Oct 30 08:00:01.768269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.768166    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" podStartSLOduration=1.768150668 podStartE2EDuration="1.768150668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:00:01.766448796 +0000 UTC m=+3804.474328965" watchObservedRunningTime="2026-10-30 08:00:01.768150668 +0000 UTC m=+3804.476030878"
Oct 30 08:00:01.815000 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.814937    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" podStartSLOduration=1.8149234779999999 podStartE2EDuration="1.814923478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:00:01.810911611 +0000 UTC m=+3804.518791785" watchObservedRunningTime="2026-10-30 08:00:01.814923478 +0000 UTC m=+3804.522803646"
Oct 30 08:00:01.864119 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:01.864060    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" podStartSLOduration=1.8640442350000002 podStartE2EDuration="1.864044235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:00:01.861938174 +0000 UTC m=+3804.569818347" watchObservedRunningTime="2026-10-30 08:00:01.864044235 +0000 UTC m=+3804.571924432"
Oct 30 08:00:02.736733 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.736697    5073 generic.go:356] "Generic (PLEG): container finished" podID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerID="692369ce156e9c7e90f0c80a5181abdc44ed7ad9ba2375b9981b7dfecf5d7d3d" exitCode=60
Oct 30 08:00:02.737231 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.736776    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerDied","Data":"692369ce156e9c7e90f0c80a5181abdc44ed7ad9ba2375b9981b7dfecf5d7d3d"}
Oct 30 08:00:02.737231 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.737123    5073 scope.go:122] "RemoveContainer" containerID="692369ce156e9c7e90f0c80a5181abdc44ed7ad9ba2375b9981b7dfecf5d7d3d"
Oct 30 08:00:02.738924 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.738895    5073 generic.go:356] "Generic (PLEG): container finished" podID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerID="a3ee212a198a5f7ee3a2d4f715bb17889cb6611b0efaf625f1043a1cd4942d02" exitCode=60
Oct 30 08:00:02.739047 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.738973    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerDied","Data":"a3ee212a198a5f7ee3a2d4f715bb17889cb6611b0efaf625f1043a1cd4942d02"}
Oct 30 08:00:02.739243 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.739225    5073 scope.go:122] "RemoveContainer" containerID="a3ee212a198a5f7ee3a2d4f715bb17889cb6611b0efaf625f1043a1cd4942d02"
Oct 30 08:00:02.741252 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.741123    5073 generic.go:356] "Generic (PLEG): container finished" podID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerID="430914d8c5e6d4b1b46216bc318f9dd6a7d773c15de6f41601740cb93532969a" exitCode=60
Oct 30 08:00:02.741252 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.741194    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerDied","Data":"430914d8c5e6d4b1b46216bc318f9dd6a7d773c15de6f41601740cb93532969a"}
Oct 30 08:00:02.741391 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:02.741376    5073 scope.go:122] "RemoveContainer" containerID="430914d8c5e6d4b1b46216bc318f9dd6a7d773c15de6f41601740cb93532969a"
Oct 30 08:00:03.751777 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:03.751735    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerStarted","Data":"1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323"}
Oct 30 08:00:03.753692 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:03.753667    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerStarted","Data":"18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3"}
Oct 30 08:00:03.765136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:03.765080    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerStarted","Data":"708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797"}
Oct 30 08:00:04.774173 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.774136    5073 generic.go:356] "Generic (PLEG): container finished" podID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerID="708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797" exitCode=60
Oct 30 08:00:04.774654 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.774274    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerDied","Data":"708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797"}
Oct 30 08:00:04.774654 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.774333    5073 scope.go:122] "RemoveContainer" containerID="692369ce156e9c7e90f0c80a5181abdc44ed7ad9ba2375b9981b7dfecf5d7d3d"
Oct 30 08:00:04.774882 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.774846    5073 scope.go:122] "RemoveContainer" containerID="708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797"
Oct 30 08:00:04.775253 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:04.775231    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9_odh-ai-gateway-infra(3bbdbbf4-f026-4db8-90fc-026829ded1af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af"
Oct 30 08:00:04.776441 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.776413    5073 generic.go:356] "Generic (PLEG): container finished" podID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerID="1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323" exitCode=60
Oct 30 08:00:04.776560 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.776505    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerDied","Data":"1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323"}
Oct 30 08:00:04.776809 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.776790    5073 scope.go:122] "RemoveContainer" containerID="1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323"
Oct 30 08:00:04.777278 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:04.777248    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq_odh-ai-gateway-infra(6cfdf133-238b-40f6-ac16-5edd894148a8)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8"
Oct 30 08:00:04.778930 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.778908    5073 generic.go:356] "Generic (PLEG): container finished" podID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerID="18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3" exitCode=60
Oct 30 08:00:04.779094 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.779029    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerDied","Data":"18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3"}
Oct 30 08:00:04.779301 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.779283    5073 scope.go:122] "RemoveContainer" containerID="18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3"
Oct 30 08:00:04.779615 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:04.779595    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p_odh-ai-gateway-infra(5741efea-b1a0-4c80-9eeb-1f16d857f872)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872"
Oct 30 08:00:04.788018 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.787981    5073 scope.go:122] "RemoveContainer" containerID="a3ee212a198a5f7ee3a2d4f715bb17889cb6611b0efaf625f1043a1cd4942d02"
Oct 30 08:00:04.803304 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:04.803276    5073 scope.go:122] "RemoveContainer" containerID="430914d8c5e6d4b1b46216bc318f9dd6a7d773c15de6f41601740cb93532969a"
Oct 30 08:00:05.788743 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:05.788705    5073 scope.go:122] "RemoveContainer" containerID="1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323"
Oct 30 08:00:05.789361 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:05.789124    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq_odh-ai-gateway-infra(6cfdf133-238b-40f6-ac16-5edd894148a8)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8"
Oct 30 08:00:05.790573 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:05.790551    5073 scope.go:122] "RemoveContainer" containerID="18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3"
Oct 30 08:00:05.790923 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:05.790902    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p_odh-ai-gateway-infra(5741efea-b1a0-4c80-9eeb-1f16d857f872)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872"
Oct 30 08:00:05.792956 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:05.792935    5073 scope.go:122] "RemoveContainer" containerID="708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797"
Oct 30 08:00:05.793253 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:05.793231    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9_odh-ai-gateway-infra(3bbdbbf4-f026-4db8-90fc-026829ded1af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af"
Oct 30 08:00:13.923770 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:13.923731    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:00:16.415073 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:16.415034    5073 scope.go:122] "RemoveContainer" containerID="18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3"
Oct 30 08:00:17.418918 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:17.418882    5073 scope.go:122] "RemoveContainer" containerID="1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323"
Oct 30 08:00:17.419310 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:17.418952    5073 scope.go:122] "RemoveContainer" containerID="708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797"
Oct 30 08:00:17.894875 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:17.894480    5073 generic.go:356] "Generic (PLEG): container finished" podID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerID="56e5cf75fcb9e9fac5ff864c8f60f3657c81ab42f857b3d344d24bd5846964b3" exitCode=60
Oct 30 08:00:17.894875 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:17.894762    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerDied","Data":"56e5cf75fcb9e9fac5ff864c8f60f3657c81ab42f857b3d344d24bd5846964b3"}
Oct 30 08:00:17.894875 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:17.894823    5073 scope.go:122] "RemoveContainer" containerID="18f4081a62947354c78f3f39395a1a4e2bbb5d6527f8cfd3710b5682d775a8b3"
Oct 30 08:00:17.897881 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:17.895388    5073 scope.go:122] "RemoveContainer" containerID="56e5cf75fcb9e9fac5ff864c8f60f3657c81ab42f857b3d344d24bd5846964b3"
Oct 30 08:00:17.897881 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:17.895791    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p_odh-ai-gateway-infra(5741efea-b1a0-4c80-9eeb-1f16d857f872)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872"
Oct 30 08:00:18.907041 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.907006    5073 generic.go:356] "Generic (PLEG): container finished" podID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerID="7d512fd3b8e65423a46fca87473814de0a2e57bbf248a1c5df3bce69bd10e549" exitCode=60
Oct 30 08:00:18.907534 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.907074    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerDied","Data":"7d512fd3b8e65423a46fca87473814de0a2e57bbf248a1c5df3bce69bd10e549"}
Oct 30 08:00:18.907534 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.907138    5073 scope.go:122] "RemoveContainer" containerID="1d7473a3222327511697e02f857901589f2b72c7fd40df9f05185fd73dda5323"
Oct 30 08:00:18.907638 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.907625    5073 scope.go:122] "RemoveContainer" containerID="7d512fd3b8e65423a46fca87473814de0a2e57bbf248a1c5df3bce69bd10e549"
Oct 30 08:00:18.908075 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:18.908047    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq_odh-ai-gateway-infra(6cfdf133-238b-40f6-ac16-5edd894148a8)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8"
Oct 30 08:00:18.912027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.912001    5073 generic.go:356] "Generic (PLEG): container finished" podID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerID="b8b5817dea2d724ca7896bdd7cf8e2db725832425281898ebd321d952d98fbfd" exitCode=60
Oct 30 08:00:18.912126 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.912078    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerDied","Data":"b8b5817dea2d724ca7896bdd7cf8e2db725832425281898ebd321d952d98fbfd"}
Oct 30 08:00:18.912579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.912558    5073 scope.go:122] "RemoveContainer" containerID="b8b5817dea2d724ca7896bdd7cf8e2db725832425281898ebd321d952d98fbfd"
Oct 30 08:00:18.913062 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:18.913038    5073 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9_odh-ai-gateway-infra(3bbdbbf4-f026-4db8-90fc-026829ded1af)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af"
Oct 30 08:00:18.925626 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.925602    5073 scope.go:122] "RemoveContainer" containerID="708da74eeb5daf6ad62e685fcdcf38cef21693cca3fe17f3664453226f560797"
Oct 30 08:00:18.961118 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:18.961083    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"]
Oct 30 08:00:19.198531 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.198505    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:19.299491 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.299452    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca\") pod \"5741efea-b1a0-4c80-9eeb-1f16d857f872\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") "
Oct 30 08:00:19.299681 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.299594    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6\" (UniqueName: \"kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6\") pod \"5741efea-b1a0-4c80-9eeb-1f16d857f872\" (UID: \"5741efea-b1a0-4c80-9eeb-1f16d857f872\") "
Oct 30 08:00:19.300543 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.300513    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca" pod "5741efea-b1a0-4c80-9eeb-1f16d857f872" (UID: "5741efea-b1a0-4c80-9eeb-1f16d857f872"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:00:19.302063 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.302034    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6" pod "5741efea-b1a0-4c80-9eeb-1f16d857f872" (UID: "5741efea-b1a0-4c80-9eeb-1f16d857f872"). InnerVolumeSpecName "kube-api-access-rdsm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:00:19.401167 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.401129    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdsm6\" (UniqueName: \"kubernetes.io/projected/5741efea-b1a0-4c80-9eeb-1f16d857f872-kube-api-access-rdsm6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:00:19.401167 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.401162    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5741efea-b1a0-4c80-9eeb-1f16d857f872-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:00:19.924707 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.924679    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"
Oct 30 08:00:19.925725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.924750    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p" event={"ID":"5741efea-b1a0-4c80-9eeb-1f16d857f872","Type":"ContainerDied","Data":"5b8d963d5716bbe252243b4aee733bbc6e9614bf0d627ccbc4ba53ebcbbb7ace"}
Oct 30 08:00:19.925845 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.925764    5073 scope.go:122] "RemoveContainer" containerID="56e5cf75fcb9e9fac5ff864c8f60f3657c81ab42f857b3d344d24bd5846964b3"
Oct 30 08:00:19.962722 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.962696    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"]
Oct 30 08:00:19.982280 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.982249    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"]
Oct 30 08:00:19.987096 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:19.987060    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-083c13ed-29889120-f2r8p"]
Oct 30 08:00:20.012629 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.012588    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"]
Oct 30 08:00:20.204006 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.203928    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:20.276343 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.276309    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:20.326905 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.322248    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca\") pod \"6cfdf133-238b-40f6-ac16-5edd894148a8\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") "
Oct 30 08:00:20.326905 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.322457    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm\" (UniqueName: \"kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm\") pod \"3bbdbbf4-f026-4db8-90fc-026829ded1af\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") "
Oct 30 08:00:20.326905 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.323319    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n\" (UniqueName: \"kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n\") pod \"6cfdf133-238b-40f6-ac16-5edd894148a8\" (UID: \"6cfdf133-238b-40f6-ac16-5edd894148a8\") "
Oct 30 08:00:20.326905 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.323359    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca\") pod \"3bbdbbf4-f026-4db8-90fc-026829ded1af\" (UID: \"3bbdbbf4-f026-4db8-90fc-026829ded1af\") "
Oct 30 08:00:20.326905 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.324172    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca" pod "3bbdbbf4-f026-4db8-90fc-026829ded1af" (UID: "3bbdbbf4-f026-4db8-90fc-026829ded1af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:00:20.326905 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.324228    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca" pod "6cfdf133-238b-40f6-ac16-5edd894148a8" (UID: "6cfdf133-238b-40f6-ac16-5edd894148a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:00:20.327378 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.326982    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n" pod "6cfdf133-238b-40f6-ac16-5edd894148a8" (UID: "6cfdf133-238b-40f6-ac16-5edd894148a8"). InnerVolumeSpecName "kube-api-access-p6h2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:00:20.329840 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.329809    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm" pod "3bbdbbf4-f026-4db8-90fc-026829ded1af" (UID: "3bbdbbf4-f026-4db8-90fc-026829ded1af"). InnerVolumeSpecName "kube-api-access-rbjbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:00:20.425548 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.425510    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbjbm\" (UniqueName: \"kubernetes.io/projected/3bbdbbf4-f026-4db8-90fc-026829ded1af-kube-api-access-rbjbm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:00:20.425548 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.425543    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6h2n\" (UniqueName: \"kubernetes.io/projected/6cfdf133-238b-40f6-ac16-5edd894148a8-kube-api-access-p6h2n\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:00:20.425548 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.425552    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbdbbf4-f026-4db8-90fc-026829ded1af-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:00:20.425787 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.425560    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfdf133-238b-40f6-ac16-5edd894148a8-maas-api-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:00:20.937869 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.937827    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"
Oct 30 08:00:20.938373 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.937868    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9" event={"ID":"3bbdbbf4-f026-4db8-90fc-026829ded1af","Type":"ContainerDied","Data":"1229fc11b25cddf380135958d0b6f2f76247c5943eb5b663549a4ed975bbcdb1"}
Oct 30 08:00:20.938373 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.937939    5073 scope.go:122] "RemoveContainer" containerID="b8b5817dea2d724ca7896bdd7cf8e2db725832425281898ebd321d952d98fbfd"
Oct 30 08:00:20.940025 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.939980    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq" event={"ID":"6cfdf133-238b-40f6-ac16-5edd894148a8","Type":"ContainerDied","Data":"2e380c45f89f9fd145570e71910201fae8cfe02f9a7fbfa5518b425f294808fd"}
Oct 30 08:00:20.940187 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.940164    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"
Oct 30 08:00:20.950206 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:20.950188    5073 scope.go:122] "RemoveContainer" containerID="7d512fd3b8e65423a46fca87473814de0a2e57bbf248a1c5df3bce69bd10e549"
Oct 30 08:00:21.028614 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.028578    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"]
Oct 30 08:00:21.045199 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.045160    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-06b26e-29889120-685tq"]
Oct 30 08:00:21.133498 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.133464    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"]
Oct 30 08:00:21.136798 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.136768    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-bb6be4-29889120-jz6f9"]
Oct 30 08:00:21.426391 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.426356    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" path="/var/lib/kubelet/pods/3bbdbbf4-f026-4db8-90fc-026829ded1af/volumes"
Oct 30 08:00:21.427070 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.427050    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" path="/var/lib/kubelet/pods/5741efea-b1a0-4c80-9eeb-1f16d857f872/volumes"
Oct 30 08:00:21.427609 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:21.427593    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" path="/var/lib/kubelet/pods/6cfdf133-238b-40f6-ac16-5edd894148a8/volumes"
Oct 30 08:00:43.924405 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:00:43.924364    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:00:59.548717 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:00:59.548677    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"]
Oct 30 08:01:04.549001 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:04.548954    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff" podUID="299c5545-17b6-4d86-b3de-84ef840a9228" containerName="payload-processing" containerID="cri-o://bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93" gracePeriod=25
Oct 30 08:01:04.844680 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:04.844654    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 08:01:04.989457 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:04.989423    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb\" (UniqueName: \"kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb\") pod \"299c5545-17b6-4d86-b3de-84ef840a9228\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") "
Oct 30 08:01:04.989663 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:04.989474    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume\") pod \"299c5545-17b6-4d86-b3de-84ef840a9228\" (UID: \"299c5545-17b6-4d86-b3de-84ef840a9228\") "
Oct 30 08:01:04.989949 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:04.989919    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume" pod "299c5545-17b6-4d86-b3de-84ef840a9228" (UID: "299c5545-17b6-4d86-b3de-84ef840a9228"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:01:04.991726 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:04.991697    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb" pod "299c5545-17b6-4d86-b3de-84ef840a9228" (UID: "299c5545-17b6-4d86-b3de-84ef840a9228"). InnerVolumeSpecName "kube-api-access-wc4nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:01:05.091502 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.091413    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc4nb\" (UniqueName: \"kubernetes.io/projected/299c5545-17b6-4d86-b3de-84ef840a9228-kube-api-access-wc4nb\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:05.091502 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.091443    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/299c5545-17b6-4d86-b3de-84ef840a9228-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:05.322670 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.322618    5073 generic.go:356] "Generic (PLEG): container finished" podID="299c5545-17b6-4d86-b3de-84ef840a9228" containerID="bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93" exitCode=0
Oct 30 08:01:05.322670 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.322667    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"
Oct 30 08:01:05.322938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.322699    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff" event={"ID":"299c5545-17b6-4d86-b3de-84ef840a9228","Type":"ContainerDied","Data":"bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93"}
Oct 30 08:01:05.322938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.322761    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff" event={"ID":"299c5545-17b6-4d86-b3de-84ef840a9228","Type":"ContainerDied","Data":"b9e2c12df6bb8fb8755e0bf7d2abeab08087cb75c02fe9130af57e4f5aaab64c"}
Oct 30 08:01:05.322938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.322784    5073 scope.go:122] "RemoveContainer" containerID="bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93"
Oct 30 08:01:05.335034 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.335012    5073 scope.go:122] "RemoveContainer" containerID="bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93"
Oct 30 08:01:05.335340 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:05.335319    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93\": container with ID starting with bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93 not found: ID does not exist" containerID="bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93"
Oct 30 08:01:05.335390 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.335350    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93"} err="failed to get container status \"bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93\": rpc error: code = NotFound desc = could not find container \"bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93\": container with ID starting with bbf86c9a002ec98681b76d02c560039aac448e2102164a9d1aecdb05c1de7e93 not found: ID does not exist"
Oct 30 08:01:05.389071 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.389035    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"]
Oct 30 08:01:05.394262 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.394232    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-a475d6-9787478-xwtff"]
Oct 30 08:01:05.425211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:05.425180    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="299c5545-17b6-4d86-b3de-84ef840a9228" path="/var/lib/kubelet/pods/299c5545-17b6-4d86-b3de-84ef840a9228/volumes"
Oct 30 08:01:13.926147 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:13.926029    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:01:35.758018 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:35.757981    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"]
Oct 30 08:01:35.758514 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:35.758218    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" podUID="ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" containerName="maas-api" containerID="cri-o://c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267" gracePeriod=30
Oct 30 08:01:36.154486 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.154455    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 08:01:36.156449 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.156420    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca\") pod \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") "
Oct 30 08:01:36.156613 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.156504    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx\" (UniqueName: \"kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx\") pod \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") "
Oct 30 08:01:36.156688 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.156668    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs\") pod \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") "
Oct 30 08:01:36.156766 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.156697    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\") pod \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\" (UID: \"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36\") "
Oct 30 08:01:36.156863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.156820    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca" pod "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" (UID: "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:01:36.157306 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.157281    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:36.158713 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.158689    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx" pod "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" (UID: "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36"). InnerVolumeSpecName "kube-api-access-j5bvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:01:36.158816 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.158718    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs" pod "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" (UID: "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:01:36.158961 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.158940    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls" pod "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" (UID: "ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:01:36.303287 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.301886    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:36.303287 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.301959    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:36.303287 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.301977    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5bvx\" (UniqueName: \"kubernetes.io/projected/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36-kube-api-access-j5bvx\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:36.558711 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.558677    5073 generic.go:356] "Generic (PLEG): container finished" podID="ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" containerID="c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267" exitCode=0
Oct 30 08:01:36.558954 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.558736    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"
Oct 30 08:01:36.558954 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.558761    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" event={"ID":"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36","Type":"ContainerDied","Data":"c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267"}
Oct 30 08:01:36.558954 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.558819    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z" event={"ID":"ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36","Type":"ContainerDied","Data":"ce2708683c334ffd47c5c22aa3a6fc2a10c983743f2e06dbec4f7525b8fe221a"}
Oct 30 08:01:36.558954 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.558848    5073 scope.go:122] "RemoveContainer" containerID="c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267"
Oct 30 08:01:36.570052 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.570037    5073 scope.go:122] "RemoveContainer" containerID="c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267"
Oct 30 08:01:36.570348 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:36.570328    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267\": container with ID starting with c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267 not found: ID does not exist" containerID="c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267"
Oct 30 08:01:36.570394 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.570357    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267"} err="failed to get container status \"c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267\": rpc error: code = NotFound desc = could not find container \"c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267\": container with ID starting with c109d365c742248b1148451ea110dd3d570fefcdd61c31f771b7c388aab8b267 not found: ID does not exist"
Oct 30 08:01:36.631302 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.631266    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"]
Oct 30 08:01:36.638634 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:36.638602    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-a475d6-58f78f6959-9tr9z"]
Oct 30 08:01:37.426543 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:37.426505    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" path="/var/lib/kubelet/pods/ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36/volumes"
Oct 30 08:01:39.639741 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:39.639715    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 08:01:39.650729 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:39.650701    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 08:01:43.924739 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:43.924686    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:01:44.884108 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:44.884072    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"]
Oct 30 08:01:44.884321 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:44.884289    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" containerID="cri-o://dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d" gracePeriod=30
Oct 30 08:01:45.452618 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:45.452581    5073 patch_prober.go:29] interesting pod/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 08:01:45.453153 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:45.452639    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 08:01:50.176508 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.176473    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 08:01:50.334265 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334226    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334469 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334306    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334469 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334364    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334469 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334437    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334656 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334552    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334656 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334603    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334774 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334672    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334774 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334714    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334774 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334750    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy\") pod \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\" (UID: \"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e\") "
Oct 30 08:01:50.334994 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334596    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:01:50.334994 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334881    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:01:50.334994 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334902    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:01:50.334994 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.334985    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:01:50.335219 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.335076    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:01:50.335524 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.335497    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.335524 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.335526    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.335725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.335540    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.335725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.335554    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.335725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.335567    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.336960 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.336930    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:01:50.337083 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.337062    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:01:50.337294 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.337277    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "kube-api-access-hcjrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:01:50.337366 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.337346    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo" pod "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" (UID: "64c96d9c-7d64-4bb2-ade2-92d5a3fc283e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:01:50.437422 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.437347    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.437422 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.437373    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.437422 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.437384    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcjrj\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-kube-api-access-hcjrj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.437422 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.437396    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:50.583335 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.583296    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"]
Oct 30 08:01:50.583777 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.583739    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p" podUID="69ac61ee-4295-47b7-b71a-939a37cb3d39" containerName="maas-api" containerID="cri-o://993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b" gracePeriod=30
Oct 30 08:01:50.667640 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.667605    5073 generic.go:356] "Generic (PLEG): container finished" podID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerID="dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d" exitCode=0
Oct 30 08:01:50.667825 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.667649    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" event={"ID":"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e","Type":"ContainerDied","Data":"dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d"}
Oct 30 08:01:50.667825 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.667668    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"
Oct 30 08:01:50.667825 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.667712    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5" event={"ID":"64c96d9c-7d64-4bb2-ade2-92d5a3fc283e","Type":"ContainerDied","Data":"75b8e5425be0ff8a5d85fa2d1ce98183ac23b2a3dbd49e9443dd6731cbd7ec89"}
Oct 30 08:01:50.667825 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.667745    5073 scope.go:122] "RemoveContainer" containerID="dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d"
Oct 30 08:01:50.698178 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.698155    5073 scope.go:122] "RemoveContainer" containerID="9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"
Oct 30 08:01:50.709830 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.709803    5073 scope.go:122] "RemoveContainer" containerID="dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d"
Oct 30 08:01:50.710152 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:50.710129    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d\": container with ID starting with dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d not found: ID does not exist" containerID="dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d"
Oct 30 08:01:50.710235 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.710162    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d"} err="failed to get container status \"dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d\": rpc error: code = NotFound desc = could not find container \"dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d\": container with ID starting with dc5a1f8389a16b04e5f77f73a33d087b7211247395e5fe84a2afdb1ac5cb414d not found: ID does not exist"
Oct 30 08:01:50.710235 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.710179    5073 scope.go:122] "RemoveContainer" containerID="9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"
Oct 30 08:01:50.710467 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:50.710445    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca\": container with ID starting with 9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca not found: ID does not exist" containerID="9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"
Oct 30 08:01:50.710564 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.710472    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca"} err="failed to get container status \"9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca\": rpc error: code = NotFound desc = could not find container \"9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca\": container with ID starting with 9e76d5ea3c429af1384cb895c7675e93f4a64e755defa894c82c0544bdb3a1ca not found: ID does not exist"
Oct 30 08:01:50.723032 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.723001    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"]
Oct 30 08:01:50.728783 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.728757    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-a475d6-openshift-default-d6b956577-ntvg5"]
Oct 30 08:01:50.926870 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:50.923434    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 08:01:51.111579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.102262    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls\") pod \"69ac61ee-4295-47b7-b71a-939a37cb3d39\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") "
Oct 30 08:01:51.111579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.102414    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4\" (UniqueName: \"kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4\") pod \"69ac61ee-4295-47b7-b71a-939a37cb3d39\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") "
Oct 30 08:01:51.111579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.102463    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca\") pod \"69ac61ee-4295-47b7-b71a-939a37cb3d39\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") "
Oct 30 08:01:51.111579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.102551    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs\") pod \"69ac61ee-4295-47b7-b71a-939a37cb3d39\" (UID: \"69ac61ee-4295-47b7-b71a-939a37cb3d39\") "
Oct 30 08:01:51.111579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.105979    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca" pod "69ac61ee-4295-47b7-b71a-939a37cb3d39" (UID: "69ac61ee-4295-47b7-b71a-939a37cb3d39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:01:51.127306 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.126523    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs" pod "69ac61ee-4295-47b7-b71a-939a37cb3d39" (UID: "69ac61ee-4295-47b7-b71a-939a37cb3d39"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:01:51.128748 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.128701    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls" pod "69ac61ee-4295-47b7-b71a-939a37cb3d39" (UID: "69ac61ee-4295-47b7-b71a-939a37cb3d39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:01:51.140746 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.140690    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4" pod "69ac61ee-4295-47b7-b71a-939a37cb3d39" (UID: "69ac61ee-4295-47b7-b71a-939a37cb3d39"). InnerVolumeSpecName "kube-api-access-zg6w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:01:51.204407 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.204358    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:51.204407 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.204402    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg6w4\" (UniqueName: \"kubernetes.io/projected/69ac61ee-4295-47b7-b71a-939a37cb3d39-kube-api-access-zg6w4\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:51.204407 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.204416    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ac61ee-4295-47b7-b71a-939a37cb3d39-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:51.204966 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.204428    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ac61ee-4295-47b7-b71a-939a37cb3d39-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:01:51.424376 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.424334    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" path="/var/lib/kubelet/pods/64c96d9c-7d64-4bb2-ade2-92d5a3fc283e/volumes"
Oct 30 08:01:51.676190 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.676106    5073 generic.go:356] "Generic (PLEG): container finished" podID="69ac61ee-4295-47b7-b71a-939a37cb3d39" containerID="993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b" exitCode=0
Oct 30 08:01:51.676190 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.676166    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"
Oct 30 08:01:51.676451 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.676188    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p" event={"ID":"69ac61ee-4295-47b7-b71a-939a37cb3d39","Type":"ContainerDied","Data":"993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b"}
Oct 30 08:01:51.676451 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.676257    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p" event={"ID":"69ac61ee-4295-47b7-b71a-939a37cb3d39","Type":"ContainerDied","Data":"cc64b8c0e7f12dc438d7889e7ed9c1e1a39db937010e10c4b983053d29949e00"}
Oct 30 08:01:51.676451 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.676288    5073 scope.go:122] "RemoveContainer" containerID="993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b"
Oct 30 08:01:51.687998 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.687975    5073 scope.go:122] "RemoveContainer" containerID="993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b"
Oct 30 08:01:51.688274 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:01:51.688251    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b\": container with ID starting with 993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b not found: ID does not exist" containerID="993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b"
Oct 30 08:01:51.688392 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.688283    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b"} err="failed to get container status \"993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b\": rpc error: code = NotFound desc = could not find container \"993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b\": container with ID starting with 993f4daf9fc4acee80a5ef62fa10ad4be39deb34791a802c3b48f5d0b070197b not found: ID does not exist"
Oct 30 08:01:51.727621 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.727594    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"]
Oct 30 08:01:51.730654 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:51.730632    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-f1f700-67475d764f-rnc2p"]
Oct 30 08:01:53.426078 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:01:53.426046    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69ac61ee-4295-47b7-b71a-939a37cb3d39" path="/var/lib/kubelet/pods/69ac61ee-4295-47b7-b71a-939a37cb3d39/volumes"
Oct 30 08:02:07.799631 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:07.799592    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"]
Oct 30 08:02:07.800170 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:07.799841    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r" podUID="489af737-000c-44b6-8555-7337428ebe7b" containerName="maas-api" containerID="cri-o://ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91" gracePeriod=30
Oct 30 08:02:08.161813 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.161785    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 08:02:08.231879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.228561    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs\") pod \"489af737-000c-44b6-8555-7337428ebe7b\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") "
Oct 30 08:02:08.231879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.228675    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls\") pod \"489af737-000c-44b6-8555-7337428ebe7b\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") "
Oct 30 08:02:08.231879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.228774    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca\") pod \"489af737-000c-44b6-8555-7337428ebe7b\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") "
Oct 30 08:02:08.231879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.228841    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2\" (UniqueName: \"kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2\") pod \"489af737-000c-44b6-8555-7337428ebe7b\" (UID: \"489af737-000c-44b6-8555-7337428ebe7b\") "
Oct 30 08:02:08.231879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.230556    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca" pod "489af737-000c-44b6-8555-7337428ebe7b" (UID: "489af737-000c-44b6-8555-7337428ebe7b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:02:08.279882 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.274590    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls" pod "489af737-000c-44b6-8555-7337428ebe7b" (UID: "489af737-000c-44b6-8555-7337428ebe7b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:02:08.279882 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.275681    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2" pod "489af737-000c-44b6-8555-7337428ebe7b" (UID: "489af737-000c-44b6-8555-7337428ebe7b"). InnerVolumeSpecName "kube-api-access-pd7z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:02:08.279882 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.275799    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs" pod "489af737-000c-44b6-8555-7337428ebe7b" (UID: "489af737-000c-44b6-8555-7337428ebe7b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:02:08.333874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.333136    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd7z2\" (UniqueName: \"kubernetes.io/projected/489af737-000c-44b6-8555-7337428ebe7b-kube-api-access-pd7z2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:08.333874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.333176    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:08.333874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.333191    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489af737-000c-44b6-8555-7337428ebe7b-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:08.333874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.333205    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489af737-000c-44b6-8555-7337428ebe7b-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:08.901393 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.901360    5073 generic.go:356] "Generic (PLEG): container finished" podID="489af737-000c-44b6-8555-7337428ebe7b" containerID="ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91" exitCode=0
Oct 30 08:02:08.901923 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.901426    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r" event={"ID":"489af737-000c-44b6-8555-7337428ebe7b","Type":"ContainerDied","Data":"ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91"}
Oct 30 08:02:08.901923 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.901440    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"
Oct 30 08:02:08.901923 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.901470    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r" event={"ID":"489af737-000c-44b6-8555-7337428ebe7b","Type":"ContainerDied","Data":"d3bab82eee915d52b29f34651ea9bd2b4bd9d81d769ec12d5692a132660d8913"}
Oct 30 08:02:08.901923 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.901497    5073 scope.go:122] "RemoveContainer" containerID="ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91"
Oct 30 08:02:08.914017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.913997    5073 scope.go:122] "RemoveContainer" containerID="ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91"
Oct 30 08:02:08.914352 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:02:08.914322    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91\": container with ID starting with ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91 not found: ID does not exist" containerID="ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91"
Oct 30 08:02:08.914429 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.914356    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91"} err="failed to get container status \"ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91\": rpc error: code = NotFound desc = could not find container \"ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91\": container with ID starting with ecd8089d35402af6b680c4bd85aaeca24261b3de8d1228e3f189f570abf1bc91 not found: ID does not exist"
Oct 30 08:02:08.979543 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.979507    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"]
Oct 30 08:02:08.991531 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:08.991501    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-9bec5c-65749bb755-glm2r"]
Oct 30 08:02:09.424790 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:09.424756    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="489af737-000c-44b6-8555-7337428ebe7b" path="/var/lib/kubelet/pods/489af737-000c-44b6-8555-7337428ebe7b/volumes"
Oct 30 08:02:13.923131 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:02:13.923072    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:02:32.180516 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:32.180471    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"]
Oct 30 08:02:32.181386 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:32.180762    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy" containerID="cri-o://0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57" gracePeriod=30
Oct 30 08:02:37.486938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.486910    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 08:02:37.510516 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510482    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.510677 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510572    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.510677 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510650    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.510809 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510682    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.510809 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510736    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.510809 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510791    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.511001 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.510902    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.511068 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.511001    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.511068 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.511009    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:37.511068 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.511044    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:37.511236 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.511080    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x\") pod \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\" (UID: \"9f91f18b-c52a-49be-ae98-41f3a4d3d401\") "
Oct 30 08:02:37.511303 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.511284    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:37.511362 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.511303    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:37.512259 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.512005    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.512259 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.512223    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.512259 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.512248    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.512511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.512263    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.512726 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.512706    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:02:37.514004 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.513980    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:37.514668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.514644    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:02:37.515010 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.514986    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:02:37.515211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.515142    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x" pod "9f91f18b-c52a-49be-ae98-41f3a4d3d401" (UID: "9f91f18b-c52a-49be-ae98-41f3a4d3d401"). InnerVolumeSpecName "kube-api-access-hwm4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:02:37.613986 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.613946    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.613986 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.613982    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.614195 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.613996    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwm4x\" (UniqueName: \"kubernetes.io/projected/9f91f18b-c52a-49be-ae98-41f3a4d3d401-kube-api-access-hwm4x\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.614195 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.614010    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.614195 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.614024    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f91f18b-c52a-49be-ae98-41f3a4d3d401-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:37.637249 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:37.637217    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"]
Oct 30 08:02:38.183240 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.183207    5073 generic.go:356] "Generic (PLEG): container finished" podID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerID="0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57" exitCode=0
Oct 30 08:02:38.183410 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.183262    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"
Oct 30 08:02:38.183410 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.183269    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" event={"ID":"9f91f18b-c52a-49be-ae98-41f3a4d3d401","Type":"ContainerDied","Data":"0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57"}
Oct 30 08:02:38.183410 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.183341    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k" event={"ID":"9f91f18b-c52a-49be-ae98-41f3a4d3d401","Type":"ContainerDied","Data":"a3f7dfed81b1cf0c311e61ad1fb1c038f34922a85bd7f0487bb9e59543e321b5"}
Oct 30 08:02:38.183410 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.183375    5073 scope.go:122] "RemoveContainer" containerID="0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57"
Oct 30 08:02:38.194171 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.194153    5073 scope.go:122] "RemoveContainer" containerID="6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"
Oct 30 08:02:38.204459 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.204439    5073 scope.go:122] "RemoveContainer" containerID="0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57"
Oct 30 08:02:38.204709 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:02:38.204690    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57\": container with ID starting with 0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57 not found: ID does not exist" containerID="0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57"
Oct 30 08:02:38.204794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.204717    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57"} err="failed to get container status \"0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57\": rpc error: code = NotFound desc = could not find container \"0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57\": container with ID starting with 0aa8b81a0b6b34fb3ab229c3d4bf969baca0145bc15b1f751ae8536b1eb2bd57 not found: ID does not exist"
Oct 30 08:02:38.204794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.204733    5073 scope.go:122] "RemoveContainer" containerID="6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"
Oct 30 08:02:38.205032 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:02:38.205010    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1\": container with ID starting with 6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1 not found: ID does not exist" containerID="6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"
Oct 30 08:02:38.205102 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.205037    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1"} err="failed to get container status \"6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1\": rpc error: code = NotFound desc = could not find container \"6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1\": container with ID starting with 6d7820e55c7eaedf3f4c48f77619d859272021eff352936f2bc6493fffaee1c1 not found: ID does not exist"
Oct 30 08:02:38.236417 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.236044    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"]
Oct 30 08:02:38.250043 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:38.250008    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d09eb6-openshift-default-84ffd8c79c-gx89k"]
Oct 30 08:02:39.433263 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:39.433222    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" path="/var/lib/kubelet/pods/9f91f18b-c52a-49be-ae98-41f3a4d3d401/volumes"
Oct 30 08:02:43.926092 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:02:43.926056    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:02:52.670903 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:52.670861    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" containerID="cri-o://af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e" gracePeriod=45
Oct 30 08:02:52.797538 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:52.797497    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": dial tcp 10.132.0.85:8000: connect: connection refused"
Oct 30 08:02:52.965704 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:52.965676    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 08:02:53.062478 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062445    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm\") pod \"dc8b0807-15b2-4029-919d-7c265542f8d8\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") "
Oct 30 08:02:53.062657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062514    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache\") pod \"dc8b0807-15b2-4029-919d-7c265542f8d8\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") "
Oct 30 08:02:53.062657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062600    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir\") pod \"dc8b0807-15b2-4029-919d-7c265542f8d8\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") "
Oct 30 08:02:53.062796 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062684    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home\") pod \"dc8b0807-15b2-4029-919d-7c265542f8d8\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") "
Oct 30 08:02:53.062872 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062788    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache" pod "dc8b0807-15b2-4029-919d-7c265542f8d8" (UID: "dc8b0807-15b2-4029-919d-7c265542f8d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:53.062872 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062819    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g\" (UniqueName: \"kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g\") pod \"dc8b0807-15b2-4029-919d-7c265542f8d8\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") "
Oct 30 08:02:53.062984 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062882    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs\") pod \"dc8b0807-15b2-4029-919d-7c265542f8d8\" (UID: \"dc8b0807-15b2-4029-919d-7c265542f8d8\") "
Oct 30 08:02:53.062984 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062907    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir" pod "dc8b0807-15b2-4029-919d-7c265542f8d8" (UID: "dc8b0807-15b2-4029-919d-7c265542f8d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:53.062984 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.062945    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home" pod "dc8b0807-15b2-4029-919d-7c265542f8d8" (UID: "dc8b0807-15b2-4029-919d-7c265542f8d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:53.063513 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.063486    5073 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-model-cache\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:53.063623 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.063537    5073 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-tmp-dir\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:53.063623 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.063551    5073 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-home\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:53.065349 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.065321    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm" pod "dc8b0807-15b2-4029-919d-7c265542f8d8" (UID: "dc8b0807-15b2-4029-919d-7c265542f8d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:02:53.065560 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.065358    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs" pod "dc8b0807-15b2-4029-919d-7c265542f8d8" (UID: "dc8b0807-15b2-4029-919d-7c265542f8d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:02:53.065560 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.065359    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g" pod "dc8b0807-15b2-4029-919d-7c265542f8d8" (UID: "dc8b0807-15b2-4029-919d-7c265542f8d8"). InnerVolumeSpecName "kube-api-access-52p4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:02:53.165026 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.164994    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52p4g\" (UniqueName: \"kubernetes.io/projected/dc8b0807-15b2-4029-919d-7c265542f8d8-kube-api-access-52p4g\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:53.165026 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.165025    5073 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8b0807-15b2-4029-919d-7c265542f8d8-tls-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:53.165223 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.165038    5073 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc8b0807-15b2-4029-919d-7c265542f8d8-dshm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:02:53.322368 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.322271    5073 generic.go:356] "Generic (PLEG): container finished" podID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerID="af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e" exitCode=0
Oct 30 08:02:53.322368 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.322322    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"
Oct 30 08:02:53.322368 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.322352    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" event={"ID":"dc8b0807-15b2-4029-919d-7c265542f8d8","Type":"ContainerDied","Data":"af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e"}
Oct 30 08:02:53.322653 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.322393    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7" event={"ID":"dc8b0807-15b2-4029-919d-7c265542f8d8","Type":"ContainerDied","Data":"fdc123b90bf9eaa0ea7f7660a848709cf8758a2e8ceba80199e224307f262389"}
Oct 30 08:02:53.322653 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.322411    5073 scope.go:122] "RemoveContainer" containerID="af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e"
Oct 30 08:02:53.336357 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.336336    5073 scope.go:122] "RemoveContainer" containerID="af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e"
Oct 30 08:02:53.336653 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:02:53.336634    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e\": container with ID starting with af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e not found: ID does not exist" containerID="af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e"
Oct 30 08:02:53.336704 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.336660    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e"} err="failed to get container status \"af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e\": rpc error: code = NotFound desc = could not find container \"af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e\": container with ID starting with af3389c5a11dfc955f314d504abf62e6069a7ac03b699da52476fd678694356e not found: ID does not exist"
Oct 30 08:02:53.387414 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.387381    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"]
Oct 30 08:02:53.398738 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.398705    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2bab4c/distinct-2-w4-2bab4c-kserve-649fc8f9f6-ccmw7"]
Oct 30 08:02:53.424801 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:02:53.424773    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" path="/var/lib/kubelet/pods/dc8b0807-15b2-4029-919d-7c265542f8d8/volumes"
Oct 30 08:03:13.922494 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:13.922461    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:03:14.625269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:14.625236    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"]
Oct 30 08:03:14.625677 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:14.625645    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" podUID="ad813659-e8b5-47f0-b5c7-4fbc76dc377e" containerName="maas-api" containerID="cri-o://78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea" gracePeriod=30
Oct 30 08:03:14.946950 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:14.946925    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 08:03:15.086276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.086243    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs\") pod \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") "
Oct 30 08:03:15.086451 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.086416    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6\" (UniqueName: \"kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6\") pod \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") "
Oct 30 08:03:15.086501 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.086468    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca\") pod \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") "
Oct 30 08:03:15.086644 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.086625    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\") pod \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\" (UID: \"ad813659-e8b5-47f0-b5c7-4fbc76dc377e\") "
Oct 30 08:03:15.087262 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.086889    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca" pod "ad813659-e8b5-47f0-b5c7-4fbc76dc377e" (UID: "ad813659-e8b5-47f0-b5c7-4fbc76dc377e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:03:15.087344 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.087259    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.088969 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.088918    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls" pod "ad813659-e8b5-47f0-b5c7-4fbc76dc377e" (UID: "ad813659-e8b5-47f0-b5c7-4fbc76dc377e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:15.089097 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.088975    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs" pod "ad813659-e8b5-47f0-b5c7-4fbc76dc377e" (UID: "ad813659-e8b5-47f0-b5c7-4fbc76dc377e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:15.089164 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.089124    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6" pod "ad813659-e8b5-47f0-b5c7-4fbc76dc377e" (UID: "ad813659-e8b5-47f0-b5c7-4fbc76dc377e"). InnerVolumeSpecName "kube-api-access-tnsp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:15.257606 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.172254    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"]
Oct 30 08:03:15.257606 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.172535    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn" podUID="5ec7a1d4-269e-43f9-884a-6e505aee95a8" containerName="maas-api" containerID="cri-o://b93bbd3e996bcd0a72531791dabf589ff78a1302967fbe1b3f5287d2ba82ad91" gracePeriod=30
Oct 30 08:03:15.277064 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.272332    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnsp6\" (UniqueName: \"kubernetes.io/projected/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-kube-api-access-tnsp6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.277064 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.272362    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.277064 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.272387    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad813659-e8b5-47f0-b5c7-4fbc76dc377e-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.503177 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.503050    5073 generic.go:356] "Generic (PLEG): container finished" podID="ad813659-e8b5-47f0-b5c7-4fbc76dc377e" containerID="78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea" exitCode=0
Oct 30 08:03:15.504947 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.503558    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" event={"ID":"ad813659-e8b5-47f0-b5c7-4fbc76dc377e","Type":"ContainerDied","Data":"78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea"}
Oct 30 08:03:15.504947 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.503630    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc" event={"ID":"ad813659-e8b5-47f0-b5c7-4fbc76dc377e","Type":"ContainerDied","Data":"485435f76c1a2893648c4ca9db94dd3107d2f68095750e762fc6af79aa0c9a40"}
Oct 30 08:03:15.504947 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.503666    5073 scope.go:122] "RemoveContainer" containerID="78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea"
Oct 30 08:03:15.504947 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.503896    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"
Oct 30 08:03:15.508129 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.507774    5073 generic.go:356] "Generic (PLEG): container finished" podID="5ec7a1d4-269e-43f9-884a-6e505aee95a8" containerID="b93bbd3e996bcd0a72531791dabf589ff78a1302967fbe1b3f5287d2ba82ad91" exitCode=0
Oct 30 08:03:15.508129 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.507835    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn" event={"ID":"5ec7a1d4-269e-43f9-884a-6e505aee95a8","Type":"ContainerDied","Data":"b93bbd3e996bcd0a72531791dabf589ff78a1302967fbe1b3f5287d2ba82ad91"}
Oct 30 08:03:15.522583 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.522563    5073 scope.go:122] "RemoveContainer" containerID="78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea"
Oct 30 08:03:15.522935 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:15.522901    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea\": container with ID starting with 78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea not found: ID does not exist" containerID="78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea"
Oct 30 08:03:15.523061 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.522945    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea"} err="failed to get container status \"78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea\": rpc error: code = NotFound desc = could not find container \"78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea\": container with ID starting with 78c4fe2e580fb9abdd7d44f4db9f8e5483c2bf1896f602121034ef8066f24dea not found: ID does not exist"
Oct 30 08:03:15.532982 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.532963    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 08:03:15.558604 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.558575    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"]
Oct 30 08:03:15.563839 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.563812    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-932c00-5b58fd6d9-skpfc"]
Oct 30 08:03:15.687873 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.650292    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca\") pod \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") "
Oct 30 08:03:15.687873 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.650593    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs\") pod \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") "
Oct 30 08:03:15.687873 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.650665    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6\" (UniqueName: \"kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6\") pod \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") "
Oct 30 08:03:15.687873 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.651038    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls\") pod \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\" (UID: \"5ec7a1d4-269e-43f9-884a-6e505aee95a8\") "
Oct 30 08:03:15.687873 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.658039    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca" pod "5ec7a1d4-269e-43f9-884a-6e505aee95a8" (UID: "5ec7a1d4-269e-43f9-884a-6e505aee95a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:03:15.706084 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.706048    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec7a1d4-269e-43f9-884a-6e505aee95a8-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.724433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.723928    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6" pod "5ec7a1d4-269e-43f9-884a-6e505aee95a8" (UID: "5ec7a1d4-269e-43f9-884a-6e505aee95a8"). InnerVolumeSpecName "kube-api-access-gv5p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:15.727391 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.727362    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls" pod "5ec7a1d4-269e-43f9-884a-6e505aee95a8" (UID: "5ec7a1d4-269e-43f9-884a-6e505aee95a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:15.730542 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.730514    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs" pod "5ec7a1d4-269e-43f9-884a-6e505aee95a8" (UID: "5ec7a1d4-269e-43f9-884a-6e505aee95a8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:15.807751 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.807661    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.807751 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.807692    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv5p6\" (UniqueName: \"kubernetes.io/projected/5ec7a1d4-269e-43f9-884a-6e505aee95a8-kube-api-access-gv5p6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:15.807751 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:15.807702    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec7a1d4-269e-43f9-884a-6e505aee95a8-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:16.518967 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:16.518939    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"
Oct 30 08:03:16.519594 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:16.518967    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn" event={"ID":"5ec7a1d4-269e-43f9-884a-6e505aee95a8","Type":"ContainerDied","Data":"0b99bdb70663bb5a1d72e8c958bf0d8fd4ee54e477fa99f61e838c457a3fe541"}
Oct 30 08:03:16.519725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:16.519635    5073 scope.go:122] "RemoveContainer" containerID="b93bbd3e996bcd0a72531791dabf589ff78a1302967fbe1b3f5287d2ba82ad91"
Oct 30 08:03:16.577006 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:16.576971    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"]
Oct 30 08:03:16.588266 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:16.588243    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-06e19a-78fd77b9d6-fv8pn"]
Oct 30 08:03:17.424166 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:17.424134    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ec7a1d4-269e-43f9-884a-6e505aee95a8" path="/var/lib/kubelet/pods/5ec7a1d4-269e-43f9-884a-6e505aee95a8/volumes"
Oct 30 08:03:17.424585 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:17.424569    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad813659-e8b5-47f0-b5c7-4fbc76dc377e" path="/var/lib/kubelet/pods/ad813659-e8b5-47f0-b5c7-4fbc76dc377e/volumes"
Oct 30 08:03:18.053144 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.053105    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"]
Oct 30 08:03:18.053663 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.053346    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6" podUID="3fc3a39e-055b-45ca-8c6f-02f8ca34532d" containerName="maas-api" containerID="cri-o://b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60" gracePeriod=30
Oct 30 08:03:18.364555 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.362276    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 08:03:18.450141 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.450105    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs\") pod \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") "
Oct 30 08:03:18.450382 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.450218    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca\") pod \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") "
Oct 30 08:03:18.450382 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.450260    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn\" (UniqueName: \"kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn\") pod \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") "
Oct 30 08:03:18.450558 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.450528    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls\") pod \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\" (UID: \"3fc3a39e-055b-45ca-8c6f-02f8ca34532d\") "
Oct 30 08:03:18.450628 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.450561    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca" pod "3fc3a39e-055b-45ca-8c6f-02f8ca34532d" (UID: "3fc3a39e-055b-45ca-8c6f-02f8ca34532d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:03:18.451182 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.451159    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:18.452951 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.452451    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs" pod "3fc3a39e-055b-45ca-8c6f-02f8ca34532d" (UID: "3fc3a39e-055b-45ca-8c6f-02f8ca34532d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:18.453420 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.453382    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn" pod "3fc3a39e-055b-45ca-8c6f-02f8ca34532d" (UID: "3fc3a39e-055b-45ca-8c6f-02f8ca34532d"). InnerVolumeSpecName "kube-api-access-jppsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:18.453564 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.453541    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls" pod "3fc3a39e-055b-45ca-8c6f-02f8ca34532d" (UID: "3fc3a39e-055b-45ca-8c6f-02f8ca34532d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:18.535709 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.535669    5073 generic.go:356] "Generic (PLEG): container finished" podID="3fc3a39e-055b-45ca-8c6f-02f8ca34532d" containerID="b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60" exitCode=0
Oct 30 08:03:18.535946 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.535718    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"
Oct 30 08:03:18.535946 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.535751    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6" event={"ID":"3fc3a39e-055b-45ca-8c6f-02f8ca34532d","Type":"ContainerDied","Data":"b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60"}
Oct 30 08:03:18.535946 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.535808    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6" event={"ID":"3fc3a39e-055b-45ca-8c6f-02f8ca34532d","Type":"ContainerDied","Data":"30756ca44f7d119841249eb7b433825a2dbcb5d56ebb774ccb53d74682aeec50"}
Oct 30 08:03:18.535946 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.535833    5073 scope.go:122] "RemoveContainer" containerID="b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60"
Oct 30 08:03:18.586883 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.574814    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jppsn\" (UniqueName: \"kubernetes.io/projected/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-kube-api-access-jppsn\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:18.586883 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.574845    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:18.586883 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.574880    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fc3a39e-055b-45ca-8c6f-02f8ca34532d-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:18.620211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.620186    5073 scope.go:122] "RemoveContainer" containerID="b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60"
Oct 30 08:03:18.620677 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:18.620646    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60\": container with ID starting with b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60 not found: ID does not exist" containerID="b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60"
Oct 30 08:03:18.620764 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.620690    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60"} err="failed to get container status \"b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60\": rpc error: code = NotFound desc = could not find container \"b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60\": container with ID starting with b9a93c58afe29051b24238b0185f2bd96c8e453163209d167f75d01c1f4a0f60 not found: ID does not exist"
Oct 30 08:03:18.643877 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.643799    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"]
Oct 30 08:03:18.649636 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:18.649601    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2bab4c-589c7d8bc5-xnkl6"]
Oct 30 08:03:19.423719 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:19.423685    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fc3a39e-055b-45ca-8c6f-02f8ca34532d" path="/var/lib/kubelet/pods/3fc3a39e-055b-45ca-8c6f-02f8ca34532d/volumes"
Oct 30 08:03:25.088902 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:25.088867    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"]
Oct 30 08:03:25.089411 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:25.089110    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy" containerID="cri-o://5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4" gracePeriod=30
Oct 30 08:03:29.183100 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:29.183058    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"]
Oct 30 08:03:29.186249 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:29.183879    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" containerID="cri-o://9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832" gracePeriod=30
Oct 30 08:03:30.371103 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.371013    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 08:03:30.457392 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457357    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457565 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457430    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457631 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457585    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457695 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457627    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457695 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457668    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457910 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457737    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457910 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457738    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:30.457910 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457773    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.457910 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457887    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:30.458123 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.457919    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.458123 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.458099    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs\") pod \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\" (UID: \"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23\") "
Oct 30 08:03:30.458230 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.458141    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:30.458901 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.458836    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.459050 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.458906    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.459050 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.458920    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.460491 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.459163    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:30.460491 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.459074    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:03:30.460491 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.460453    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:03:30.461894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.461473    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:30.461894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.461657    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:30.461894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.461828    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6" pod "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" (UID: "9e8f8ad1-7d95-48e4-95f0-cd2b71078e23"). InnerVolumeSpecName "kube-api-access-5ktd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:30.559925 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.559889    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ktd6\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-kube-api-access-5ktd6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.559925 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.559929    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.560155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.559945    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.560155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.559958    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.560155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.559971    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.560155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.559983    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:30.652531 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.652491    5073 generic.go:356] "Generic (PLEG): container finished" podID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerID="5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4" exitCode=0
Oct 30 08:03:30.652715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.652547    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"
Oct 30 08:03:30.652715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.652558    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" event={"ID":"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23","Type":"ContainerDied","Data":"5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4"}
Oct 30 08:03:30.652715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.652619    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s" event={"ID":"9e8f8ad1-7d95-48e4-95f0-cd2b71078e23","Type":"ContainerDied","Data":"2729c06912bcaadbfcfc9d50c7e478a6d5e31e7b12282ce075cca6a0660ffedb"}
Oct 30 08:03:30.652715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.652642    5073 scope.go:122] "RemoveContainer" containerID="5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4"
Oct 30 08:03:30.663992 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.663972    5073 scope.go:122] "RemoveContainer" containerID="71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"
Oct 30 08:03:30.674091 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.674065    5073 scope.go:122] "RemoveContainer" containerID="5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4"
Oct 30 08:03:30.674477 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:30.674454    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4\": container with ID starting with 5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4 not found: ID does not exist" containerID="5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4"
Oct 30 08:03:30.674584 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.674484    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4"} err="failed to get container status \"5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4\": rpc error: code = NotFound desc = could not find container \"5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4\": container with ID starting with 5487823fa10362765327e6762f52b049f89c0940a912d473ac2f039806a91df4 not found: ID does not exist"
Oct 30 08:03:30.674584 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.674503    5073 scope.go:122] "RemoveContainer" containerID="71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"
Oct 30 08:03:30.674838 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:30.674812    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6\": container with ID starting with 71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6 not found: ID does not exist" containerID="71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"
Oct 30 08:03:30.674946 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.674839    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6"} err="failed to get container status \"71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6\": rpc error: code = NotFound desc = could not find container \"71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6\": container with ID starting with 71280cbaead522fd665417e41f50da06e6b7f5813c60ff0ad9d41ebfb2adf9d6 not found: ID does not exist"
Oct 30 08:03:30.684241 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.684217    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"]
Oct 30 08:03:30.713198 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.713166    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"]
Oct 30 08:03:30.730117 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:30.730080    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-06e19a-openshift-default-6ddddc4467-d9q4s"]
Oct 30 08:03:31.423540 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:31.423502    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" path="/var/lib/kubelet/pods/9e8f8ad1-7d95-48e4-95f0-cd2b71078e23/volumes"
Oct 30 08:03:34.487334 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.487300    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 08:03:34.513346 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513310    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.513522 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513356    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.513522 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513417    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.513522 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513442    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.513522 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513494    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.514136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513554    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.514136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513584    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.514136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513692    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.514136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513745    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs\") pod \"fee496f0-8439-4d38-8b30-59be3c7fbd34\" (UID: \"fee496f0-8439-4d38-8b30-59be3c7fbd34\") "
Oct 30 08:03:34.514136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513828    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:34.514136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.513846    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:34.514517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.514198    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:03:34.514517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.514421    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fee496f0-8439-4d38-8b30-59be3c7fbd34-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.514517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.514465    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.514517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.514480    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.514517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.514418    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:34.514517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.514440    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:34.517022 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.516982    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:03:34.517022 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.516994    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:34.517197 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.517037    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "kube-api-access-j74vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:34.517247 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.517196    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token" pod "fee496f0-8439-4d38-8b30-59be3c7fbd34" (UID: "fee496f0-8439-4d38-8b30-59be3c7fbd34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:34.616200 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.616165    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.616200 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.616201    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j74vj\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-kube-api-access-j74vj\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.616413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.616215    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.616413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.616229    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.616413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.616244    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.616413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.616258    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fee496f0-8439-4d38-8b30-59be3c7fbd34-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:34.682817 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.682783    5073 generic.go:356] "Generic (PLEG): container finished" podID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerID="9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832" exitCode=0
Oct 30 08:03:34.683076 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.682845    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"
Oct 30 08:03:34.683076 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.682890    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" event={"ID":"fee496f0-8439-4d38-8b30-59be3c7fbd34","Type":"ContainerDied","Data":"9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832"}
Oct 30 08:03:34.683076 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.682957    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" event={"ID":"fee496f0-8439-4d38-8b30-59be3c7fbd34","Type":"ContainerDied","Data":"acfa7b3b6c764b6f706a9585bc1d56a0bde90ac7de03a0dd30dfb7a4e5d94c74"}
Oct 30 08:03:34.683076 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.682987    5073 scope.go:122] "RemoveContainer" containerID="9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832"
Oct 30 08:03:34.694898 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.694878    5073 scope.go:122] "RemoveContainer" containerID="9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832"
Oct 30 08:03:34.695194 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:34.695168    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832\": container with ID starting with 9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832 not found: ID does not exist" containerID="9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832"
Oct 30 08:03:34.695290 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.695202    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832"} err="failed to get container status \"9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832\": rpc error: code = NotFound desc = could not find container \"9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832\": container with ID starting with 9cc0015d1221de909d252efe0b237412e2d186126ec9db83d0e9a1092cc49832 not found: ID does not exist"
Oct 30 08:03:34.734477 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.734397    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"]
Oct 30 08:03:34.738702 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:34.738675    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg"]
Oct 30 08:03:35.410938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:35.410904    5073 patch_prober.go:29] interesting pod/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 08:03:35.411133 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:35.410965    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-2bab4c-openshift-default-df548679c-xbtzg" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 08:03:35.424268 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:35.424237    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" path="/var/lib/kubelet/pods/fee496f0-8439-4d38-8b30-59be3c7fbd34/volumes"
Oct 30 08:03:43.924172 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:43.924131    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:03:45.708079 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:45.708012    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main" containerID="cri-o://35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc" gracePeriod=45
Oct 30 08:03:45.991287 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:45.991257    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 08:03:46.066836 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.066800    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache\") pod \"f691d503-b3ce-4587-83b9-99bf39214197\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") "
Oct 30 08:03:46.067027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.066843    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm\") pod \"f691d503-b3ce-4587-83b9-99bf39214197\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") "
Oct 30 08:03:46.067027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.066958    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw\" (UniqueName: \"kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw\") pod \"f691d503-b3ce-4587-83b9-99bf39214197\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") "
Oct 30 08:03:46.067027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.067018    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs\" (UniqueName: \"kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs\") pod \"f691d503-b3ce-4587-83b9-99bf39214197\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") "
Oct 30 08:03:46.067206 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.067113    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache" pod "f691d503-b3ce-4587-83b9-99bf39214197" (UID: "f691d503-b3ce-4587-83b9-99bf39214197"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:46.067499 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.067474    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home\") pod \"f691d503-b3ce-4587-83b9-99bf39214197\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") "
Oct 30 08:03:46.067759 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.067738    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home" pod "f691d503-b3ce-4587-83b9-99bf39214197" (UID: "f691d503-b3ce-4587-83b9-99bf39214197"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:46.067930 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.067909    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir\") pod \"f691d503-b3ce-4587-83b9-99bf39214197\" (UID: \"f691d503-b3ce-4587-83b9-99bf39214197\") "
Oct 30 08:03:46.068167 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.068143    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir" pod "f691d503-b3ce-4587-83b9-99bf39214197" (UID: "f691d503-b3ce-4587-83b9-99bf39214197"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:46.068938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.068913    5073 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-model-cache\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:46.069044 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.068942    5073 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-home\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:46.069044 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.068956    5073 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-tmp-dir\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:46.076899 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.069568    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs" pod "f691d503-b3ce-4587-83b9-99bf39214197" (UID: "f691d503-b3ce-4587-83b9-99bf39214197"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:46.076899 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.069650    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm" pod "f691d503-b3ce-4587-83b9-99bf39214197" (UID: "f691d503-b3ce-4587-83b9-99bf39214197"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:03:46.076899 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.069698    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw" pod "f691d503-b3ce-4587-83b9-99bf39214197" (UID: "f691d503-b3ce-4587-83b9-99bf39214197"). InnerVolumeSpecName "kube-api-access-lm2vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:46.170166 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.170128    5073 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f691d503-b3ce-4587-83b9-99bf39214197-dshm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:46.170166 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.170162    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm2vw\" (UniqueName: \"kubernetes.io/projected/f691d503-b3ce-4587-83b9-99bf39214197-kube-api-access-lm2vw\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:46.170374 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.170177    5073 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f691d503-b3ce-4587-83b9-99bf39214197-tls-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:46.770540 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.770500    5073 generic.go:356] "Generic (PLEG): container finished" podID="f691d503-b3ce-4587-83b9-99bf39214197" containerID="35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc" exitCode=0
Oct 30 08:03:46.771061 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.770549    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"
Oct 30 08:03:46.771061 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.770585    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" event={"ID":"f691d503-b3ce-4587-83b9-99bf39214197","Type":"ContainerDied","Data":"35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc"}
Oct 30 08:03:46.771061 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.770630    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98" event={"ID":"f691d503-b3ce-4587-83b9-99bf39214197","Type":"ContainerDied","Data":"8240d9c06bbab98ab50ea1b97afb0c14821956a9fb711add721f5d1fde7533d1"}
Oct 30 08:03:46.771061 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.770648    5073 scope.go:122] "RemoveContainer" containerID="35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc"
Oct 30 08:03:46.783496 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.783477    5073 scope.go:122] "RemoveContainer" containerID="35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc"
Oct 30 08:03:46.783783 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:46.783758    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc\": container with ID starting with 35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc not found: ID does not exist" containerID="35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc"
Oct 30 08:03:46.783880 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.783794    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc"} err="failed to get container status \"35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc\": rpc error: code = NotFound desc = could not find container \"35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc\": container with ID starting with 35844fa71147e4fd20bc7601ebe3462734bfef1831c6dc94097e9ec718d541dc not found: ID does not exist"
Oct 30 08:03:46.820576 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.820548    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"]
Oct 30 08:03:46.831309 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:46.831283    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-4fe2ed/distinct-w1-4fe2ed-kserve-5dd98858b8-ggs98"]
Oct 30 08:03:47.424297 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:47.424264    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f691d503-b3ce-4587-83b9-99bf39214197" path="/var/lib/kubelet/pods/f691d503-b3ce-4587-83b9-99bf39214197/volumes"
Oct 30 08:03:48.012142 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.011921    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"]
Oct 30 08:03:48.013117 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.013081    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv" podUID="86e64f24-1e24-46b6-a554-671fd4a040a2" containerName="maas-api" containerID="cri-o://ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1" gracePeriod=30
Oct 30 08:03:48.343328 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.343295    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 08:03:48.407256 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.407166    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5\" (UniqueName: \"kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5\") pod \"86e64f24-1e24-46b6-a554-671fd4a040a2\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") "
Oct 30 08:03:48.407445 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.407287    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca\") pod \"86e64f24-1e24-46b6-a554-671fd4a040a2\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") "
Oct 30 08:03:48.407445 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.407318    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs\") pod \"86e64f24-1e24-46b6-a554-671fd4a040a2\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") "
Oct 30 08:03:48.407631 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.407471    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls\") pod \"86e64f24-1e24-46b6-a554-671fd4a040a2\" (UID: \"86e64f24-1e24-46b6-a554-671fd4a040a2\") "
Oct 30 08:03:48.408111 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.408085    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca" pod "86e64f24-1e24-46b6-a554-671fd4a040a2" (UID: "86e64f24-1e24-46b6-a554-671fd4a040a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:03:48.410189 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.410152    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs" pod "86e64f24-1e24-46b6-a554-671fd4a040a2" (UID: "86e64f24-1e24-46b6-a554-671fd4a040a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:48.410485 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.410464    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5" pod "86e64f24-1e24-46b6-a554-671fd4a040a2" (UID: "86e64f24-1e24-46b6-a554-671fd4a040a2"). InnerVolumeSpecName "kube-api-access-56gq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:03:48.411740 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.411713    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls" pod "86e64f24-1e24-46b6-a554-671fd4a040a2" (UID: "86e64f24-1e24-46b6-a554-671fd4a040a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:03:48.509435 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.509396    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56gq5\" (UniqueName: \"kubernetes.io/projected/86e64f24-1e24-46b6-a554-671fd4a040a2-kube-api-access-56gq5\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:48.509435 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.509434    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e64f24-1e24-46b6-a554-671fd4a040a2-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:48.509700 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.509450    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:48.509700 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.509463    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e64f24-1e24-46b6-a554-671fd4a040a2-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:03:48.787481 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.787436    5073 generic.go:356] "Generic (PLEG): container finished" podID="86e64f24-1e24-46b6-a554-671fd4a040a2" containerID="ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1" exitCode=0
Oct 30 08:03:48.787668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.787495    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"
Oct 30 08:03:48.787668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.787511    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv" event={"ID":"86e64f24-1e24-46b6-a554-671fd4a040a2","Type":"ContainerDied","Data":"ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1"}
Oct 30 08:03:48.787668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.787565    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv" event={"ID":"86e64f24-1e24-46b6-a554-671fd4a040a2","Type":"ContainerDied","Data":"23e4a44e0f6b53ef295c4a4550bf1dc94533582574446e973ef5531a0773331c"}
Oct 30 08:03:48.787668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.787594    5073 scope.go:122] "RemoveContainer" containerID="ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1"
Oct 30 08:03:48.798567 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.798550    5073 scope.go:122] "RemoveContainer" containerID="ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1"
Oct 30 08:03:48.798841 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:03:48.798816    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1\": container with ID starting with ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1 not found: ID does not exist" containerID="ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1"
Oct 30 08:03:48.798973 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.798846    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1"} err="failed to get container status \"ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1\": rpc error: code = NotFound desc = could not find container \"ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1\": container with ID starting with ad224b5833ed33f1c7c4b73f98a842ecab7eb617d3c3192dee091766315e28d1 not found: ID does not exist"
Oct 30 08:03:48.837953 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.837919    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"]
Oct 30 08:03:48.849731 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:48.849703    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-137122-7fc67c586c-lmzpv"]
Oct 30 08:03:49.424980 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:03:49.424945    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86e64f24-1e24-46b6-a554-671fd4a040a2" path="/var/lib/kubelet/pods/86e64f24-1e24-46b6-a554-671fd4a040a2/volumes"
Oct 30 08:04:01.993610 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:01.993572    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"]
Oct 30 08:04:07.849782 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:07.849739    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"]
Oct 30 08:04:07.884017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:07.883982    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"]
Oct 30 08:04:12.850430 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:12.850372    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing" containerID="cri-o://39aaff95f826ca8671264f06784d9b32902a4ed754a713f2c7d1fec7ea7d2439" gracePeriod=25
Oct 30 08:04:12.885064 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:12.885016    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing" containerID="cri-o://dab5fdc88bb974023bfde4a7393d0fc8cb81b96459e6a703d10c68b1c2ecabf5" gracePeriod=25
Oct 30 08:04:13.167157 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:13.167122    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:04:13.167340 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:13.167135    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:04:13.929396 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:13.929354    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:04:17.017913 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.017843    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main" containerID="cri-o://e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865" gracePeriod=45
Oct 30 08:04:17.049737 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:17.049710    5073 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d98e771_de3f_40d3_83be_e3ed54995a3d.slice/crio-e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 08:04:17.324636 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.324608    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 08:04:17.426830 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.426799    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache\") pod \"2d98e771-de3f-40d3-83be-e3ed54995a3d\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") "
Oct 30 08:04:17.427025 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.426837    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home\") pod \"2d98e771-de3f-40d3-83be-e3ed54995a3d\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") "
Oct 30 08:04:17.427025 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.426971    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm\") pod \"2d98e771-de3f-40d3-83be-e3ed54995a3d\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") "
Oct 30 08:04:17.427163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427025    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb\" (UniqueName: \"kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb\") pod \"2d98e771-de3f-40d3-83be-e3ed54995a3d\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") "
Oct 30 08:04:17.427163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427059    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir\") pod \"2d98e771-de3f-40d3-83be-e3ed54995a3d\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") "
Oct 30 08:04:17.427163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427072    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache" pod "2d98e771-de3f-40d3-83be-e3ed54995a3d" (UID: "2d98e771-de3f-40d3-83be-e3ed54995a3d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:17.427163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427091    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs\") pod \"2d98e771-de3f-40d3-83be-e3ed54995a3d\" (UID: \"2d98e771-de3f-40d3-83be-e3ed54995a3d\") "
Oct 30 08:04:17.427163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427147    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home" pod "2d98e771-de3f-40d3-83be-e3ed54995a3d" (UID: "2d98e771-de3f-40d3-83be-e3ed54995a3d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:17.427382 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427349    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir" pod "2d98e771-de3f-40d3-83be-e3ed54995a3d" (UID: "2d98e771-de3f-40d3-83be-e3ed54995a3d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:17.427612 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427594    5073 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-tmp-dir\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:17.427695 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427613    5073 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-model-cache\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:17.427695 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.427622    5073 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-home\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:17.429330 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.429303    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm" pod "2d98e771-de3f-40d3-83be-e3ed54995a3d" (UID: "2d98e771-de3f-40d3-83be-e3ed54995a3d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:17.429433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.429331    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs" pod "2d98e771-de3f-40d3-83be-e3ed54995a3d" (UID: "2d98e771-de3f-40d3-83be-e3ed54995a3d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:04:17.429433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.429339    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb" pod "2d98e771-de3f-40d3-83be-e3ed54995a3d" (UID: "2d98e771-de3f-40d3-83be-e3ed54995a3d"). InnerVolumeSpecName "kube-api-access-p4dbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:17.528694 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.528605    5073 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d98e771-de3f-40d3-83be-e3ed54995a3d-dshm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:17.528694 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.528641    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4dbb\" (UniqueName: \"kubernetes.io/projected/2d98e771-de3f-40d3-83be-e3ed54995a3d-kube-api-access-p4dbb\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:17.528694 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:17.528656    5073 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d98e771-de3f-40d3-83be-e3ed54995a3d-tls-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:18.007801 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.007761    5073 generic.go:356] "Generic (PLEG): container finished" podID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerID="e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865" exitCode=0
Oct 30 08:04:18.008027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.007923    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" event={"ID":"2d98e771-de3f-40d3-83be-e3ed54995a3d","Type":"ContainerDied","Data":"e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865"}
Oct 30 08:04:18.008027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.007989    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s" event={"ID":"2d98e771-de3f-40d3-83be-e3ed54995a3d","Type":"ContainerDied","Data":"b0f6f6ec7c542a876e3aaf0d783301cedbfec85e760527d38e9bfa96524f7f0e"}
Oct 30 08:04:18.008027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.008016    5073 scope.go:122] "RemoveContainer" containerID="e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865"
Oct 30 08:04:18.008188 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.008172    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"
Oct 30 08:04:18.031768 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.030817    5073 scope.go:122] "RemoveContainer" containerID="e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865"
Oct 30 08:04:18.031768 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:18.031347    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865\": container with ID starting with e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865 not found: ID does not exist" containerID="e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865"
Oct 30 08:04:18.031768 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.031378    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865"} err="failed to get container status \"e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865\": rpc error: code = NotFound desc = could not find container \"e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865\": container with ID starting with e6a18548dc57365a1eb62e50d24bd757dbae14b4ec563a9873dfcd301067b865 not found: ID does not exist"
Oct 30 08:04:18.064538 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.064499    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"]
Oct 30 08:04:18.077616 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:18.075968    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-bb6be4/distinct-w2-bb6be4-kserve-5dd96d7bfd-s984s"]
Oct 30 08:04:19.431738 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:19.431543    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" path="/var/lib/kubelet/pods/2d98e771-de3f-40d3-83be-e3ed54995a3d/volumes"
Oct 30 08:04:19.458136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:19.458104    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"]
Oct 30 08:04:19.458355 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:19.458328    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" containerID="cri-o://8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c" gracePeriod=30
Oct 30 08:04:23.167265 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:23.167230    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:04:23.167654 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:23.167263    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:04:24.333436 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.333399    5073 patch_prober.go:29] interesting pod/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 08:04:24.333818 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.333457    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 08:04:24.746606 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.746577    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 08:04:24.816607 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816572    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.816794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816632    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.816794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816670    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.816794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816711    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.816794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816775    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.817081 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816819    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.817081 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816896    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.817081 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816969    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.817081 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.817072    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo\") pod \"96809b63-5022-485a-a1cf-24f47bd96f44\" (UID: \"96809b63-5022-485a-a1cf-24f47bd96f44\") "
Oct 30 08:04:24.817688 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.816893    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:24.817794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.817060    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:24.817794 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.817647    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:04:24.818015 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.817930    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:24.818113 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.818094    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:24.820591 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.820399    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:24.820684 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.820608    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "kube-api-access-skh6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:24.822681 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.822648    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:04:24.822780 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.822703    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy" pod "96809b63-5022-485a-a1cf-24f47bd96f44" (UID: "96809b63-5022-485a-a1cf-24f47bd96f44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:24.919276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919187    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919229    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919244    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919256    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96809b63-5022-485a-a1cf-24f47bd96f44-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919269    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919561 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919281    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96809b63-5022-485a-a1cf-24f47bd96f44-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919561 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919295    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919561 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919308    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96809b63-5022-485a-a1cf-24f47bd96f44-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:24.919561 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:24.919322    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skh6v\" (UniqueName: \"kubernetes.io/projected/96809b63-5022-485a-a1cf-24f47bd96f44-kube-api-access-skh6v\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:25.060870 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.060827    5073 generic.go:356] "Generic (PLEG): container finished" podID="96809b63-5022-485a-a1cf-24f47bd96f44" containerID="8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c" exitCode=0
Oct 30 08:04:25.061062 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.060901    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"
Oct 30 08:04:25.061062 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.060909    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" event={"ID":"96809b63-5022-485a-a1cf-24f47bd96f44","Type":"ContainerDied","Data":"8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c"}
Oct 30 08:04:25.061062 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.060977    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b" event={"ID":"96809b63-5022-485a-a1cf-24f47bd96f44","Type":"ContainerDied","Data":"21d9d266665df891da795e51e638dee6d70a92fd293c32bb838b5967961e301d"}
Oct 30 08:04:25.061062 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.061000    5073 scope.go:122] "RemoveContainer" containerID="8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c"
Oct 30 08:04:25.072085 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.072069    5073 scope.go:122] "RemoveContainer" containerID="8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c"
Oct 30 08:04:25.072371 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:25.072352    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c\": container with ID starting with 8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c not found: ID does not exist" containerID="8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c"
Oct 30 08:04:25.072439 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.072384    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c"} err="failed to get container status \"8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c\": rpc error: code = NotFound desc = could not find container \"8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c\": container with ID starting with 8b67a6ecf3607fcc794d82b4de185a0d99a8d42e58b9e1eb7bb0e7df3ac9ad5c not found: ID does not exist"
Oct 30 08:04:25.111304 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.111273    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"]
Oct 30 08:04:25.122609 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.122583    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4fe2ed-openshift-default-d7c86499-g6v8b"]
Oct 30 08:04:25.433737 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:25.433702    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" path="/var/lib/kubelet/pods/96809b63-5022-485a-a1cf-24f47bd96f44/volumes"
Oct 30 08:04:32.862805 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:32.862759    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"]
Oct 30 08:04:32.863291 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:32.863019    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f" podUID="75931c81-5679-447e-bdb2-d29caf32830b" containerName="maas-api" containerID="cri-o://6b5bbc39948763d9c79ea8e6818d4129ddce9ee0b55ab44d2209962c57830bb6" gracePeriod=30
Oct 30 08:04:33.178501 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.178453    5073 generic.go:356] "Generic (PLEG): container finished" podID="0491151e-4c57-4f97-a109-0f9c41917f82" containerID="39aaff95f826ca8671264f06784d9b32902a4ed754a713f2c7d1fec7ea7d2439" exitCode=0
Oct 30 08:04:33.178654 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.178633    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" event={"ID":"0491151e-4c57-4f97-a109-0f9c41917f82","Type":"ContainerDied","Data":"39aaff95f826ca8671264f06784d9b32902a4ed754a713f2c7d1fec7ea7d2439"}
Oct 30 08:04:33.182680 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.182531    5073 generic.go:356] "Generic (PLEG): container finished" podID="75931c81-5679-447e-bdb2-d29caf32830b" containerID="6b5bbc39948763d9c79ea8e6818d4129ddce9ee0b55ab44d2209962c57830bb6" exitCode=0
Oct 30 08:04:33.182680 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.182575    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f" event={"ID":"75931c81-5679-447e-bdb2-d29caf32830b","Type":"ContainerDied","Data":"6b5bbc39948763d9c79ea8e6818d4129ddce9ee0b55ab44d2209962c57830bb6"}
Oct 30 08:04:33.187341 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.184713    5073 generic.go:356] "Generic (PLEG): container finished" podID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerID="dab5fdc88bb974023bfde4a7393d0fc8cb81b96459e6a703d10c68b1c2ecabf5" exitCode=0
Oct 30 08:04:33.187341 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.184803    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" event={"ID":"58d2e1af-ea71-4540-b85c-158dca17fa50","Type":"ContainerDied","Data":"dab5fdc88bb974023bfde4a7393d0fc8cb81b96459e6a703d10c68b1c2ecabf5"}
Oct 30 08:04:33.204809 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.204781    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 08:04:33.333291 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.332970    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 08:04:33.351873 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.351832    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 08:04:33.359665 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.359065    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume\") pod \"0491151e-4c57-4f97-a109-0f9c41917f82\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") "
Oct 30 08:04:33.360366 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.360103    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7\" (UniqueName: \"kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7\") pod \"0491151e-4c57-4f97-a109-0f9c41917f82\" (UID: \"0491151e-4c57-4f97-a109-0f9c41917f82\") "
Oct 30 08:04:33.360366 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.360190    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume" pod "0491151e-4c57-4f97-a109-0f9c41917f82" (UID: "0491151e-4c57-4f97-a109-0f9c41917f82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:04:33.360727 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.360685    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0491151e-4c57-4f97-a109-0f9c41917f82-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.364925 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.363064    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7" pod "0491151e-4c57-4f97-a109-0f9c41917f82" (UID: "0491151e-4c57-4f97-a109-0f9c41917f82"). InnerVolumeSpecName "kube-api-access-jscd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:33.472931 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.472822    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume\") pod \"58d2e1af-ea71-4540-b85c-158dca17fa50\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") "
Oct 30 08:04:33.472931 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.472925    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs\") pod \"75931c81-5679-447e-bdb2-d29caf32830b\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") "
Oct 30 08:04:33.473163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.472959    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p\" (UniqueName: \"kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p\") pod \"58d2e1af-ea71-4540-b85c-158dca17fa50\" (UID: \"58d2e1af-ea71-4540-b85c-158dca17fa50\") "
Oct 30 08:04:33.473163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.473000    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca\") pod \"75931c81-5679-447e-bdb2-d29caf32830b\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") "
Oct 30 08:04:33.473163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.473045    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8\" (UniqueName: \"kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8\") pod \"75931c81-5679-447e-bdb2-d29caf32830b\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") "
Oct 30 08:04:33.497088 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.473173    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls\") pod \"75931c81-5679-447e-bdb2-d29caf32830b\" (UID: \"75931c81-5679-447e-bdb2-d29caf32830b\") "
Oct 30 08:04:33.497088 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.473640    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jscd7\" (UniqueName: \"kubernetes.io/projected/0491151e-4c57-4f97-a109-0f9c41917f82-kube-api-access-jscd7\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.497088 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.487323    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume" pod "58d2e1af-ea71-4540-b85c-158dca17fa50" (UID: "58d2e1af-ea71-4540-b85c-158dca17fa50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:04:33.497088 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.488032    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca" pod "75931c81-5679-447e-bdb2-d29caf32830b" (UID: "75931c81-5679-447e-bdb2-d29caf32830b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:04:33.532280 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.532228    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs" pod "75931c81-5679-447e-bdb2-d29caf32830b" (UID: "75931c81-5679-447e-bdb2-d29caf32830b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:04:33.560876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.560818    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p" pod "58d2e1af-ea71-4540-b85c-158dca17fa50" (UID: "58d2e1af-ea71-4540-b85c-158dca17fa50"). InnerVolumeSpecName "kube-api-access-mfk8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:33.562111 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.562060    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8" pod "75931c81-5679-447e-bdb2-d29caf32830b" (UID: "75931c81-5679-447e-bdb2-d29caf32830b"). InnerVolumeSpecName "kube-api-access-srkv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:33.571083 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.570698    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls" pod "75931c81-5679-447e-bdb2-d29caf32830b" (UID: "75931c81-5679-447e-bdb2-d29caf32830b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:04:33.575904 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.575787    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.575904 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.575816    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58d2e1af-ea71-4540-b85c-158dca17fa50-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.575904 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.575830    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75931c81-5679-447e-bdb2-d29caf32830b-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.575904 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.575843    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfk8p\" (UniqueName: \"kubernetes.io/projected/58d2e1af-ea71-4540-b85c-158dca17fa50-kube-api-access-mfk8p\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.575904 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.575869    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75931c81-5679-447e-bdb2-d29caf32830b-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:33.575904 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:33.575881    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srkv8\" (UniqueName: \"kubernetes.io/projected/75931c81-5679-447e-bdb2-d29caf32830b-kube-api-access-srkv8\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:34.166881 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.166744    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.74:50052\" within 1s: context deadline exceeded"
Oct 30 08:04:34.166881 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:04:34.166810    5073 logging.go:55] [core] [Channel #7081 SubChannel #7082]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.74:50052", ServerName: "10.132.0.74:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.74:50052: operation was canceled"
Oct 30 08:04:34.166881 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.166830    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 08:04:34.167810 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.167783    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.73:50052\" within 1s: context deadline exceeded"
Oct 30 08:04:34.167989 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.167841    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 08:04:34.167989 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:04:34.167888    5073 logging.go:55] [core] [Channel #7079 SubChannel #7080]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.73:50052", ServerName: "10.132.0.73:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.73:50052: operation was canceled"
Oct 30 08:04:34.191921 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.191881    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f" event={"ID":"75931c81-5679-447e-bdb2-d29caf32830b","Type":"ContainerDied","Data":"5acf092d631837a74e640a9e741649118283a615f5fd6991ab8334c9e3078747"}
Oct 30 08:04:34.192093 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.191903    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"
Oct 30 08:04:34.192093 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.191957    5073 scope.go:122] "RemoveContainer" containerID="6b5bbc39948763d9c79ea8e6818d4129ddce9ee0b55ab44d2209962c57830bb6"
Oct 30 08:04:34.193725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.193672    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"
Oct 30 08:04:34.193796 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.193738    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l" event={"ID":"58d2e1af-ea71-4540-b85c-158dca17fa50","Type":"ContainerDied","Data":"797dbd54bd7fa751910d2b0860a45aa1afaf8486210c16c4c713e340d04a171b"}
Oct 30 08:04:34.195592 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.195556    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"
Oct 30 08:04:34.195592 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.195582    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n" event={"ID":"0491151e-4c57-4f97-a109-0f9c41917f82","Type":"ContainerDied","Data":"39f7aeefb719da198754c45059ca210170f49d4a070341ec3e02b662cb9b3b3d"}
Oct 30 08:04:34.206478 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.206439    5073 scope.go:122] "RemoveContainer" containerID="dab5fdc88bb974023bfde4a7393d0fc8cb81b96459e6a703d10c68b1c2ecabf5"
Oct 30 08:04:34.217587 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.217567    5073 scope.go:122] "RemoveContainer" containerID="39aaff95f826ca8671264f06784d9b32902a4ed754a713f2c7d1fec7ea7d2439"
Oct 30 08:04:34.258436 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.258403    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"]
Oct 30 08:04:34.268021 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.267983    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bb6be4-64cbbf58cb-2jl6n"]
Oct 30 08:04:34.299494 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.299461    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"]
Oct 30 08:04:34.302213 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.302185    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bb6be4-b98c9db6b-c967f"]
Oct 30 08:04:34.335895 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.335865    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"]
Oct 30 08:04:34.343089 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:34.343056    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bb6be4-f5dfd65ff-s2v6l"]
Oct 30 08:04:35.423334 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:35.423300    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" path="/var/lib/kubelet/pods/0491151e-4c57-4f97-a109-0f9c41917f82/volumes"
Oct 30 08:04:35.423907 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:35.423889    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" path="/var/lib/kubelet/pods/58d2e1af-ea71-4540-b85c-158dca17fa50/volumes"
Oct 30 08:04:35.424468 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:35.424451    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75931c81-5679-447e-bdb2-d29caf32830b" path="/var/lib/kubelet/pods/75931c81-5679-447e-bdb2-d29caf32830b/volumes"
Oct 30 08:04:41.862168 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:41.862123    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"]
Oct 30 08:04:41.862669 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:41.862372    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy" containerID="cri-o://2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012" gracePeriod=30
Oct 30 08:04:43.922088 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:43.922044    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:04:47.146492 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.146432    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 08:04:47.261092 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261054    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261092 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261098    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261306 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261127    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261306 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261162    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261306 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261200    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261306 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261266    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261533 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261325    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261533 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261363    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.261533 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261390    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:47.261533 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261515    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:04:47.261696 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.261559    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data\") pod \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\" (UID: \"aa733e26-9561-4b9c-a4eb-5ac0e927245b\") "
Oct 30 08:04:47.262228 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.262201    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:47.264606 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.264427    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "kube-api-access-krx6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:47.265890 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.264770    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:47.265890 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.264786    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:47.266067 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.265842    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.266067 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.265999    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krx6l\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-kube-api-access-krx6l\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.266067 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.266017    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.266067 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.266032    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.266067 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.266051    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.266067 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.266066    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.266459 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.266426    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:04:47.276044 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.276014    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:04:47.276983 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.276020    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy" pod "aa733e26-9561-4b9c-a4eb-5ac0e927245b" (UID: "aa733e26-9561-4b9c-a4eb-5ac0e927245b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:04:47.286141 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.286114    5073 generic.go:356] "Generic (PLEG): container finished" podID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerID="2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012" exitCode=0
Oct 30 08:04:47.286250 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.286173    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"
Oct 30 08:04:47.286291 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.286175    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" event={"ID":"aa733e26-9561-4b9c-a4eb-5ac0e927245b","Type":"ContainerDied","Data":"2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012"}
Oct 30 08:04:47.286345 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.286326    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp" event={"ID":"aa733e26-9561-4b9c-a4eb-5ac0e927245b","Type":"ContainerDied","Data":"319408a8b171ad836f569289ccfe3b67c7e954545f179b95b8125eda2a626107"}
Oct 30 08:04:47.286385 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.286363    5073 scope.go:122] "RemoveContainer" containerID="2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012"
Oct 30 08:04:47.301382 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.301366    5073 scope.go:122] "RemoveContainer" containerID="3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"
Oct 30 08:04:47.310978 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.310957    5073 scope.go:122] "RemoveContainer" containerID="2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012"
Oct 30 08:04:47.311272 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:47.311246    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012\": container with ID starting with 2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012 not found: ID does not exist" containerID="2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012"
Oct 30 08:04:47.311355 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.311278    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012"} err="failed to get container status \"2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012\": rpc error: code = NotFound desc = could not find container \"2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012\": container with ID starting with 2d9a965f40538a972a9816ae77fbde521f647833b1d50789b51d1ea883f1c012 not found: ID does not exist"
Oct 30 08:04:47.311355 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.311295    5073 scope.go:122] "RemoveContainer" containerID="3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"
Oct 30 08:04:47.311552 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:04:47.311536    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91\": container with ID starting with 3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91 not found: ID does not exist" containerID="3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"
Oct 30 08:04:47.311598 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.311558    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91"} err="failed to get container status \"3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91\": rpc error: code = NotFound desc = could not find container \"3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91\": container with ID starting with 3d00c70641e7b8a9e7d2c5390ae946064f3f3cce2cc21dce0e46a545637b3f91 not found: ID does not exist"
Oct 30 08:04:47.338322 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.338296    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"]
Oct 30 08:04:47.347347 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.347325    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bb6be4-openshift-default-8557dddb7-f29kp"]
Oct 30 08:04:47.366820 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.366768    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.366820 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.366792    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.366820 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.366800    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa733e26-9561-4b9c-a4eb-5ac0e927245b-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:04:47.423690 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:47.423597    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" path="/var/lib/kubelet/pods/aa733e26-9561-4b9c-a4eb-5ac0e927245b/volumes"
Oct 30 08:04:59.243133 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:04:59.243096    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"]
Oct 30 08:05:13.924057 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:05:13.924013    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:05:14.266059 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.265935    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" podUID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" containerName="main" containerID="cri-o://3e47f689ffdc0c01c61023b500a8764de372669dc5a5f72ab8489fd43eb04e26" gracePeriod=45
Oct 30 08:05:14.494249 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.494217    5073 generic.go:356] "Generic (PLEG): container finished" podID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" containerID="3e47f689ffdc0c01c61023b500a8764de372669dc5a5f72ab8489fd43eb04e26" exitCode=0
Oct 30 08:05:14.494423 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.494292    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" event={"ID":"e9d19ace-9eac-41c4-b167-d496d4ca74b8","Type":"ContainerDied","Data":"3e47f689ffdc0c01c61023b500a8764de372669dc5a5f72ab8489fd43eb04e26"}
Oct 30 08:05:14.551825 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.551801    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 08:05:14.612385 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612343    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir\") pod \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") "
Oct 30 08:05:14.612623 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612451    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache\") pod \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") "
Oct 30 08:05:14.612623 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612495    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs\") pod \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") "
Oct 30 08:05:14.612623 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612526    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm\") pod \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") "
Oct 30 08:05:14.612623 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612564    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home\") pod \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") "
Oct 30 08:05:14.612968 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612807    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home" pod "e9d19ace-9eac-41c4-b167-d496d4ca74b8" (UID: "e9d19ace-9eac-41c4-b167-d496d4ca74b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:14.612968 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.612950    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir" pod "e9d19ace-9eac-41c4-b167-d496d4ca74b8" (UID: "e9d19ace-9eac-41c4-b167-d496d4ca74b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:14.613172 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.613148    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache" pod "e9d19ace-9eac-41c4-b167-d496d4ca74b8" (UID: "e9d19ace-9eac-41c4-b167-d496d4ca74b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:14.613276 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.613258    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv\" (UniqueName: \"kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv\") pod \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\" (UID: \"e9d19ace-9eac-41c4-b167-d496d4ca74b8\") "
Oct 30 08:05:14.613887 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.613829    5073 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tmp-dir\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:14.613887 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.613868    5073 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-model-cache\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:14.613887 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.613882    5073 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-home\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:14.616196 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.616140    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs" pod "e9d19ace-9eac-41c4-b167-d496d4ca74b8" (UID: "e9d19ace-9eac-41c4-b167-d496d4ca74b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:05:14.617242 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.617218    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm" pod "e9d19ace-9eac-41c4-b167-d496d4ca74b8" (UID: "e9d19ace-9eac-41c4-b167-d496d4ca74b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:14.617351 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.617334    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv" pod "e9d19ace-9eac-41c4-b167-d496d4ca74b8" (UID: "e9d19ace-9eac-41c4-b167-d496d4ca74b8"). InnerVolumeSpecName "kube-api-access-dpwjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:05:14.714760 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.714710    5073 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d19ace-9eac-41c4-b167-d496d4ca74b8-tls-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:14.714760 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.714757    5073 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9d19ace-9eac-41c4-b167-d496d4ca74b8-dshm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:14.714760 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:14.714773    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpwjv\" (UniqueName: \"kubernetes.io/projected/e9d19ace-9eac-41c4-b167-d496d4ca74b8-kube-api-access-dpwjv\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:15.482340 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:15.482294    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" podUID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.192:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 08:05:15.502122 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:15.502092    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"
Oct 30 08:05:15.502122 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:15.502104    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf" event={"ID":"e9d19ace-9eac-41c4-b167-d496d4ca74b8","Type":"ContainerDied","Data":"6c8b8528b3609f64225425d871076c85fce1a40e9f13b46e459bf612292355b0"}
Oct 30 08:05:15.502347 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:15.502164    5073 scope.go:122] "RemoveContainer" containerID="3e47f689ffdc0c01c61023b500a8764de372669dc5a5f72ab8489fd43eb04e26"
Oct 30 08:05:15.558142 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:15.558108    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"]
Oct 30 08:05:15.569811 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:15.569782    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w0-bd8589/sub-test-model-bd8589-kserve-54cc456b9-tm6qf"]
Oct 30 08:05:17.422303 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:17.422267    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" path="/var/lib/kubelet/pods/e9d19ace-9eac-41c4-b167-d496d4ca74b8/volumes"
Oct 30 08:05:29.644915 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:29.644875    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"]
Oct 30 08:05:29.645474 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:29.645160    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy" containerID="cri-o://b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2" gracePeriod=30
Oct 30 08:05:34.917220 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.917152    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 08:05:34.990646 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990614    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.990871 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990722    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.990871 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990759    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.990871 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990826    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.991083 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990887    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.991083 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990931    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.991083 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.990941    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:34.991083 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991053    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.991313 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991139    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:34.991313 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991143    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.991313 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991211    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs\") pod \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\" (UID: \"1d444b8a-2478-4417-9cc9-be7f4a4d242c\") "
Oct 30 08:05:34.991477 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991343    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:34.992016 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991748    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:34.992016 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991776    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:34.992016 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.991792    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:34.993278 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.993013    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:05:34.993528 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.993478    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:34.994186 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.994152    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:34.996135 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.996105    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:05:34.996248 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.996226    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:05:34.996684 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:34.996646    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645" pod "1d444b8a-2478-4417-9cc9-be7f4a4d242c" (UID: "1d444b8a-2478-4417-9cc9-be7f4a4d242c"). InnerVolumeSpecName "kube-api-access-gj645". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:05:35.093213 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.093172    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:35.093213 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.093205    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:35.093213 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.093215    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:35.093604 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.093224    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj645\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-kube-api-access-gj645\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:35.093604 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.093234    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d444b8a-2478-4417-9cc9-be7f4a4d242c-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:35.093604 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.093243    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d444b8a-2478-4417-9cc9-be7f4a4d242c-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:35.639670 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.639635    5073 generic.go:356] "Generic (PLEG): container finished" podID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerID="b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2" exitCode=0
Oct 30 08:05:35.639860 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.639680    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"
Oct 30 08:05:35.639860 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.639714    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" event={"ID":"1d444b8a-2478-4417-9cc9-be7f4a4d242c","Type":"ContainerDied","Data":"b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2"}
Oct 30 08:05:35.639860 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.639766    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr" event={"ID":"1d444b8a-2478-4417-9cc9-be7f4a4d242c","Type":"ContainerDied","Data":"37fe234a5beef8077557e3c3c85956558d5ea0a6f0b5f2c2c02160166d195788"}
Oct 30 08:05:35.639860 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.639791    5073 scope.go:122] "RemoveContainer" containerID="b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2"
Oct 30 08:05:35.649907 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.649841    5073 scope.go:122] "RemoveContainer" containerID="b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2"
Oct 30 08:05:35.650136 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:05:35.650117    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2\": container with ID starting with b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2 not found: ID does not exist" containerID="b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2"
Oct 30 08:05:35.650189 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.650143    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2"} err="failed to get container status \"b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2\": rpc error: code = NotFound desc = could not find container \"b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2\": container with ID starting with b6e3ad21192fbe59d6d33bb5a3a87daff9fb9836ef29998c7395db5edb4344d2 not found: ID does not exist"
Oct 30 08:05:35.702332 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.702242    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"]
Oct 30 08:05:35.716634 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:35.716598    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-8d0c2f-openshift-default-f5cccd78f-54crr"]
Oct 30 08:05:37.422017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:37.421984    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" path="/var/lib/kubelet/pods/1d444b8a-2478-4417-9cc9-be7f4a4d242c/volumes"
Oct 30 08:05:43.923932 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:05:43.923888    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:05:45.261239 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.261204    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"]
Oct 30 08:05:45.261752 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.261483    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn" podUID="90aae629-aa1b-47a8-9175-ed746e57fe00" containerName="maas-api" containerID="cri-o://f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc" gracePeriod=30
Oct 30 08:05:45.562267 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.562237    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 08:05:45.706801 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.706769    5073 generic.go:356] "Generic (PLEG): container finished" podID="90aae629-aa1b-47a8-9175-ed746e57fe00" containerID="f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc" exitCode=0
Oct 30 08:05:45.707007 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.706817    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"
Oct 30 08:05:45.707007 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.706870    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn" event={"ID":"90aae629-aa1b-47a8-9175-ed746e57fe00","Type":"ContainerDied","Data":"f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc"}
Oct 30 08:05:45.707007 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.706930    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn" event={"ID":"90aae629-aa1b-47a8-9175-ed746e57fe00","Type":"ContainerDied","Data":"39ddc991ccd3d18d1c22fc4ec76d154bc5d9a0f6d04674eafe7d0620d9d3eece"}
Oct 30 08:05:45.707007 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.706958    5073 scope.go:122] "RemoveContainer" containerID="f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc"
Oct 30 08:05:45.717932 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.717908    5073 scope.go:122] "RemoveContainer" containerID="f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc"
Oct 30 08:05:45.718232 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:05:45.718210    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc\": container with ID starting with f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc not found: ID does not exist" containerID="f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc"
Oct 30 08:05:45.718347 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.718238    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc"} err="failed to get container status \"f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc\": rpc error: code = NotFound desc = could not find container \"f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc\": container with ID starting with f0f6d6efcddade9bd7d2ae2ee87dd9c19a524c5969da93e69c87ae8037e6f3bc not found: ID does not exist"
Oct 30 08:05:45.724107 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.724081    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs\") pod \"90aae629-aa1b-47a8-9175-ed746e57fe00\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") "
Oct 30 08:05:45.724260 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.724123    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv\" (UniqueName: \"kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv\") pod \"90aae629-aa1b-47a8-9175-ed746e57fe00\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") "
Oct 30 08:05:45.724353 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.724332    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls\") pod \"90aae629-aa1b-47a8-9175-ed746e57fe00\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") "
Oct 30 08:05:45.724509 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.724491    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca\") pod \"90aae629-aa1b-47a8-9175-ed746e57fe00\" (UID: \"90aae629-aa1b-47a8-9175-ed746e57fe00\") "
Oct 30 08:05:45.725018 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.724860    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca" pod "90aae629-aa1b-47a8-9175-ed746e57fe00" (UID: "90aae629-aa1b-47a8-9175-ed746e57fe00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:05:45.725018 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.724994    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90aae629-aa1b-47a8-9175-ed746e57fe00-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:45.727568 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.727161    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls" pod "90aae629-aa1b-47a8-9175-ed746e57fe00" (UID: "90aae629-aa1b-47a8-9175-ed746e57fe00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:05:45.728307 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.728287    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv" pod "90aae629-aa1b-47a8-9175-ed746e57fe00" (UID: "90aae629-aa1b-47a8-9175-ed746e57fe00"). InnerVolumeSpecName "kube-api-access-ht8pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:05:45.728462 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.728438    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs" pod "90aae629-aa1b-47a8-9175-ed746e57fe00" (UID: "90aae629-aa1b-47a8-9175-ed746e57fe00"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:05:45.825785 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.825691    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:45.825785 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.825725    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aae629-aa1b-47a8-9175-ed746e57fe00-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:45.825785 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:45.825739    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht8pv\" (UniqueName: \"kubernetes.io/projected/90aae629-aa1b-47a8-9175-ed746e57fe00-kube-api-access-ht8pv\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:46.055974 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:46.055936    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"]
Oct 30 08:05:46.059766 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:46.059737    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-e27e0c-784b64ff8f-m9pnn"]
Oct 30 08:05:47.421235 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:47.421205    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90aae629-aa1b-47a8-9175-ed746e57fe00" path="/var/lib/kubelet/pods/90aae629-aa1b-47a8-9175-ed746e57fe00/volumes"
Oct 30 08:05:53.465588 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:53.465549    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"]
Oct 30 08:05:53.466115 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:53.465784    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" containerID="cri-o://094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce" gracePeriod=30
Oct 30 08:05:58.737370 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.737304    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 08:05:58.774147 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774116    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774346 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774160    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774346 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774234    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774346 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774259    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774346 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774284    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774572 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774402    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774572 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774486    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774572 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774541    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774572 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774569    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo\") pod \"40daf937-243d-4106-8b1b-fbeb5077765c\" (UID: \"40daf937-243d-4106-8b1b-fbeb5077765c\") "
Oct 30 08:05:58.774791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774603    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:58.774791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774634    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:58.774791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774738    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:58.775010 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.774833    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:58.775145 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.775117    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.775284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.775149    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.775284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.775164    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.775284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.775180    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.775284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.775223    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:05:58.776635 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.776610    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:05:58.776735 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.776725    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "kube-api-access-8m82q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:05:58.777094 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.777076    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:05:58.777167 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.777112    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token" pod "40daf937-243d-4106-8b1b-fbeb5077765c" (UID: "40daf937-243d-4106-8b1b-fbeb5077765c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:05:58.786314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.786135    5073 generic.go:356] "Generic (PLEG): container finished" podID="40daf937-243d-4106-8b1b-fbeb5077765c" containerID="094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce" exitCode=0
Oct 30 08:05:58.786314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.786209    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"
Oct 30 08:05:58.786314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.786219    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" event={"ID":"40daf937-243d-4106-8b1b-fbeb5077765c","Type":"ContainerDied","Data":"094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce"}
Oct 30 08:05:58.786314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.786282    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" event={"ID":"40daf937-243d-4106-8b1b-fbeb5077765c","Type":"ContainerDied","Data":"88b84e8cb2ac92867f6e3d7ae6d866e2066c027bcf1fcdaaf1f79c81dd145fc0"}
Oct 30 08:05:58.786314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.786313    5073 scope.go:122] "RemoveContainer" containerID="094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce"
Oct 30 08:05:58.819546 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.819520    5073 scope.go:122] "RemoveContainer" containerID="07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"
Oct 30 08:05:58.830884 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.830835    5073 scope.go:122] "RemoveContainer" containerID="094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce"
Oct 30 08:05:58.831179 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:05:58.831150    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce\": container with ID starting with 094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce not found: ID does not exist" containerID="094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce"
Oct 30 08:05:58.831269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.831192    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce"} err="failed to get container status \"094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce\": rpc error: code = NotFound desc = could not find container \"094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce\": container with ID starting with 094aa6d38b1f7e7b308c8999d543a95ea39e508f2d4e89b41b346f045ceab2ce not found: ID does not exist"
Oct 30 08:05:58.831269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.831216    5073 scope.go:122] "RemoveContainer" containerID="07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"
Oct 30 08:05:58.831539 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:05:58.831516    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29\": container with ID starting with 07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29 not found: ID does not exist" containerID="07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"
Oct 30 08:05:58.831603 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.831549    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29"} err="failed to get container status \"07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29\": rpc error: code = NotFound desc = could not find container \"07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29\": container with ID starting with 07775a0f0393765e1282efdb7007d203949351aea494a715c6611057b5040b29 not found: ID does not exist"
Oct 30 08:05:58.845792 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.845764    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"]
Oct 30 08:05:58.852599 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.852567    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l"]
Oct 30 08:05:58.876571 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.876540    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.876571 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.876568    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40daf937-243d-4106-8b1b-fbeb5077765c-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.876730 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.876582    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40daf937-243d-4106-8b1b-fbeb5077765c-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.876730 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.876594    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m82q\" (UniqueName: \"kubernetes.io/projected/40daf937-243d-4106-8b1b-fbeb5077765c-kube-api-access-8m82q\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:58.876730 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:58.876608    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40daf937-243d-4106-8b1b-fbeb5077765c-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:05:59.421951 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:59.421913    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" path="/var/lib/kubelet/pods/40daf937-243d-4106-8b1b-fbeb5077765c/volumes"
Oct 30 08:05:59.705998 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:59.705913    5073 patch_prober.go:29] interesting pod/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.161:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 08:05:59.705998 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:05:59.705981    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-b-e27e0c-openshift-default-565694ccb5-sw54l" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.161:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 08:06:11.947622 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:11.947586    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"]
Oct 30 08:06:11.948161 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:11.947795    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp" podUID="2ef277a0-b7d4-4882-9adb-309a713ccb74" containerName="maas-api" containerID="cri-o://4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c" gracePeriod=30
Oct 30 08:06:12.223119 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.222812    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 08:06:12.331955 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.331915    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls\") pod \"2ef277a0-b7d4-4882-9adb-309a713ccb74\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") "
Oct 30 08:06:12.332163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.331982    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca\") pod \"2ef277a0-b7d4-4882-9adb-309a713ccb74\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") "
Oct 30 08:06:12.332163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.332036    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256\" (UniqueName: \"kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256\") pod \"2ef277a0-b7d4-4882-9adb-309a713ccb74\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") "
Oct 30 08:06:12.332163 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.332135    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs\") pod \"2ef277a0-b7d4-4882-9adb-309a713ccb74\" (UID: \"2ef277a0-b7d4-4882-9adb-309a713ccb74\") "
Oct 30 08:06:12.332435 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.332401    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca" pod "2ef277a0-b7d4-4882-9adb-309a713ccb74" (UID: "2ef277a0-b7d4-4882-9adb-309a713ccb74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:06:12.332614 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.332587    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef277a0-b7d4-4882-9adb-309a713ccb74-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:12.334328 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.334300    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls" pod "2ef277a0-b7d4-4882-9adb-309a713ccb74" (UID: "2ef277a0-b7d4-4882-9adb-309a713ccb74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:06:12.334712 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.334685    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs" pod "2ef277a0-b7d4-4882-9adb-309a713ccb74" (UID: "2ef277a0-b7d4-4882-9adb-309a713ccb74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:06:12.334807 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.334694    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256" pod "2ef277a0-b7d4-4882-9adb-309a713ccb74" (UID: "2ef277a0-b7d4-4882-9adb-309a713ccb74"). InnerVolumeSpecName "kube-api-access-82256". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:06:12.436874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.434282    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:12.436874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.434322    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82256\" (UniqueName: \"kubernetes.io/projected/2ef277a0-b7d4-4882-9adb-309a713ccb74-kube-api-access-82256\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:12.436874 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.434332    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ef277a0-b7d4-4882-9adb-309a713ccb74-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:12.883824 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.883783    5073 generic.go:356] "Generic (PLEG): container finished" podID="2ef277a0-b7d4-4882-9adb-309a713ccb74" containerID="4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c" exitCode=0
Oct 30 08:06:12.883824 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.883837    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp" event={"ID":"2ef277a0-b7d4-4882-9adb-309a713ccb74","Type":"ContainerDied","Data":"4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c"}
Oct 30 08:06:12.884155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.883845    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"
Oct 30 08:06:12.884155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.883915    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp" event={"ID":"2ef277a0-b7d4-4882-9adb-309a713ccb74","Type":"ContainerDied","Data":"c1ff8050ce565213efa4664caebef86768cfecd53abc348d07279bba4ba6189e"}
Oct 30 08:06:12.884155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.883960    5073 scope.go:122] "RemoveContainer" containerID="4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c"
Oct 30 08:06:12.896613 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.896588    5073 scope.go:122] "RemoveContainer" containerID="4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c"
Oct 30 08:06:12.896896 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:12.896873    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c\": container with ID starting with 4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c not found: ID does not exist" containerID="4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c"
Oct 30 08:06:12.896989 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.896907    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c"} err="failed to get container status \"4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c\": rpc error: code = NotFound desc = could not find container \"4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c\": container with ID starting with 4a03c4e0031b261f6bf8af235e3bfc039018d1dae07266c2032c6ab9e504886c not found: ID does not exist"
Oct 30 08:06:12.934172 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.934143    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"]
Oct 30 08:06:12.945434 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:12.945405    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-bd8589-5d59bbfbd6-lbnnp"]
Oct 30 08:06:13.423311 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:13.423276    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ef277a0-b7d4-4882-9adb-309a713ccb74" path="/var/lib/kubelet/pods/2ef277a0-b7d4-4882-9adb-309a713ccb74/volumes"
Oct 30 08:06:13.922245 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:13.922207    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:06:18.551906 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.551806    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"]
Oct 30 08:06:18.554437 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.552111    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" podUID="a9f962fc-0cec-4652-b269-db7a6b81d5e6" containerName="maas-api" containerID="cri-o://780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48" gracePeriod=30
Oct 30 08:06:18.833770 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.833745    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 08:06:18.911237 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.911196    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs\") pod \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") "
Oct 30 08:06:18.911436 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.911259    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht\" (UniqueName: \"kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht\") pod \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") "
Oct 30 08:06:18.911436 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.911377    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\") pod \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") "
Oct 30 08:06:18.911579 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.911515    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca\") pod \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\" (UID: \"a9f962fc-0cec-4652-b269-db7a6b81d5e6\") "
Oct 30 08:06:18.913288 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.913237    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca" pod "a9f962fc-0cec-4652-b269-db7a6b81d5e6" (UID: "a9f962fc-0cec-4652-b269-db7a6b81d5e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:06:18.914344 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.914317    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht" pod "a9f962fc-0cec-4652-b269-db7a6b81d5e6" (UID: "a9f962fc-0cec-4652-b269-db7a6b81d5e6"). InnerVolumeSpecName "kube-api-access-tmcht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:06:18.920039 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.919907    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs" pod "a9f962fc-0cec-4652-b269-db7a6b81d5e6" (UID: "a9f962fc-0cec-4652-b269-db7a6b81d5e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:06:18.923101 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.923046    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls" pod "a9f962fc-0cec-4652-b269-db7a6b81d5e6" (UID: "a9f962fc-0cec-4652-b269-db7a6b81d5e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:06:18.926269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.926236    5073 generic.go:356] "Generic (PLEG): container finished" podID="a9f962fc-0cec-4652-b269-db7a6b81d5e6" containerID="780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48" exitCode=0
Oct 30 08:06:18.926392 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.926279    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"
Oct 30 08:06:18.926392 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.926349    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" event={"ID":"a9f962fc-0cec-4652-b269-db7a6b81d5e6","Type":"ContainerDied","Data":"780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48"}
Oct 30 08:06:18.926392 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.926391    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw" event={"ID":"a9f962fc-0cec-4652-b269-db7a6b81d5e6","Type":"ContainerDied","Data":"24270351f90b4622621038da3d577abb7561ebd17d701c5150c75e2266236040"}
Oct 30 08:06:18.926569 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.926412    5073 scope.go:122] "RemoveContainer" containerID="780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48"
Oct 30 08:06:18.942840 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.942822    5073 scope.go:122] "RemoveContainer" containerID="780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48"
Oct 30 08:06:18.943132 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:18.943111    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48\": container with ID starting with 780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48 not found: ID does not exist" containerID="780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48"
Oct 30 08:06:18.943199 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.943138    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48"} err="failed to get container status \"780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48\": rpc error: code = NotFound desc = could not find container \"780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48\": container with ID starting with 780e1c9896c652782aaa204ab279ceecc906c6a38bf945fa8a1120d04d536e48 not found: ID does not exist"
Oct 30 08:06:18.982508 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.982485    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"]
Oct 30 08:06:18.992975 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:18.992954    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ace8fb-c77d9cf58-jfxsw"]
Oct 30 08:06:19.017550 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:19.016609    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:19.017550 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:19.016657    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmcht\" (UniqueName: \"kubernetes.io/projected/a9f962fc-0cec-4652-b269-db7a6b81d5e6-kube-api-access-tmcht\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:19.017550 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:19.016674    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f962fc-0cec-4652-b269-db7a6b81d5e6-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:19.017550 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:19.016690    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f962fc-0cec-4652-b269-db7a6b81d5e6-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:19.422285 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:19.422240    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9f962fc-0cec-4652-b269-db7a6b81d5e6" path="/var/lib/kubelet/pods/a9f962fc-0cec-4652-b269-db7a6b81d5e6/volumes"
Oct 30 08:06:28.286069 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:28.286032    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"]
Oct 30 08:06:28.286507 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:28.286346    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy" containerID="cri-o://60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c" gracePeriod=30
Oct 30 08:06:33.561934 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.561883    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 08:06:33.684790 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.684756    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.684880    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.684954    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685168 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685090    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685168 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685153    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685286 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685093    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:06:33.685286 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685202    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685286 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685270    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685298    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:06:33.685657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685315    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685359    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy\") pod \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\" (UID: \"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d\") "
Oct 30 08:06:33.685657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685460    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:06:33.685903 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685702    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:06:33.685972 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.685958    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:06:33.686327 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.686306    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.686374 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.686335    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.686374 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.686351    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.686374 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.686364    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.686490 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.686377    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.687364 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.687332    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:06:33.687696 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.687675    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "kube-api-access-d4b87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:06:33.687772 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.687714    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:06:33.687772 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.687725    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token" pod "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" (UID: "1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:06:33.787492 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.787459    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.787492 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.787485    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.787492 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.787494    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4b87\" (UniqueName: \"kubernetes.io/projected/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-kube-api-access-d4b87\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:33.787793 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:33.787505    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:34.019544 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.019510    5073 generic.go:356] "Generic (PLEG): container finished" podID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerID="60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c" exitCode=0
Oct 30 08:06:34.019715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.019557    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"
Oct 30 08:06:34.019715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.019590    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" event={"ID":"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d","Type":"ContainerDied","Data":"60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c"}
Oct 30 08:06:34.019715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.019647    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9" event={"ID":"1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d","Type":"ContainerDied","Data":"8b30fe37da8360fa6b9f19ef465548bb688c0fca1d4f2f0791fb635a6a2b4fa2"}
Oct 30 08:06:34.019715 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.019671    5073 scope.go:122] "RemoveContainer" containerID="60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c"
Oct 30 08:06:34.029891 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.029844    5073 scope.go:122] "RemoveContainer" containerID="52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"
Oct 30 08:06:34.038394 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.038374    5073 scope.go:122] "RemoveContainer" containerID="60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c"
Oct 30 08:06:34.038660 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:34.038641    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c\": container with ID starting with 60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c not found: ID does not exist" containerID="60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c"
Oct 30 08:06:34.038735 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.038671    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c"} err="failed to get container status \"60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c\": rpc error: code = NotFound desc = could not find container \"60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c\": container with ID starting with 60bc4312cfb40d243c228dba3a4ac45333190ed84c113cfbc720b5453fe1650c not found: ID does not exist"
Oct 30 08:06:34.038735 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.038695    5073 scope.go:122] "RemoveContainer" containerID="52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"
Oct 30 08:06:34.038975 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:34.038953    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51\": container with ID starting with 52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51 not found: ID does not exist" containerID="52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"
Oct 30 08:06:34.039106 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.038976    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51"} err="failed to get container status \"52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51\": rpc error: code = NotFound desc = could not find container \"52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51\": container with ID starting with 52f91009324dab24ca3deba326c6536b8c322a84a518b4c02ec4f95b12791b51 not found: ID does not exist"
Oct 30 08:06:34.073273 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.073244    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"]
Oct 30 08:06:34.084398 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:34.084365    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-ace8fb-openshift-default-7954b5dbfc-shxc9"]
Oct 30 08:06:35.422929 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:35.422887    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" path="/var/lib/kubelet/pods/1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d/volumes"
Oct 30 08:06:39.690887 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:39.690832    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 08:06:39.697652 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:39.697622    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-m59nb_7c4c7ef9-3135-44ee-afd2-f49226ff7ba9/console-operator/2.log"
Oct 30 08:06:43.927368 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:43.927266    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:06:47.368685 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.364328    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"]
Oct 30 08:06:47.368685 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.364572    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk" podUID="b7644ada-8fa5-472e-805b-f9aac69a2709" containerName="maas-api" containerID="cri-o://60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7" gracePeriod=30
Oct 30 08:06:47.672069 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.672043    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 08:06:47.845508 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.845469    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca\") pod \"b7644ada-8fa5-472e-805b-f9aac69a2709\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") "
Oct 30 08:06:47.845668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.845545    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls\") pod \"b7644ada-8fa5-472e-805b-f9aac69a2709\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") "
Oct 30 08:06:47.845668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.845611    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs\") pod \"b7644ada-8fa5-472e-805b-f9aac69a2709\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") "
Oct 30 08:06:47.845668 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.845642    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6\" (UniqueName: \"kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6\") pod \"b7644ada-8fa5-472e-805b-f9aac69a2709\" (UID: \"b7644ada-8fa5-472e-805b-f9aac69a2709\") "
Oct 30 08:06:47.845953 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.845926    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca" pod "b7644ada-8fa5-472e-805b-f9aac69a2709" (UID: "b7644ada-8fa5-472e-805b-f9aac69a2709"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:06:47.846194 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.846171    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7644ada-8fa5-472e-805b-f9aac69a2709-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:47.847920 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.847825    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6" pod "b7644ada-8fa5-472e-805b-f9aac69a2709" (UID: "b7644ada-8fa5-472e-805b-f9aac69a2709"). InnerVolumeSpecName "kube-api-access-94kn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:06:47.848267 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.848243    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs" pod "b7644ada-8fa5-472e-805b-f9aac69a2709" (UID: "b7644ada-8fa5-472e-805b-f9aac69a2709"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:06:47.848337 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.848283    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls" pod "b7644ada-8fa5-472e-805b-f9aac69a2709" (UID: "b7644ada-8fa5-472e-805b-f9aac69a2709"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:06:47.947717 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.947637    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:47.947717 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.947666    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7644ada-8fa5-472e-805b-f9aac69a2709-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:47.947717 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:47.947677    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94kn6\" (UniqueName: \"kubernetes.io/projected/b7644ada-8fa5-472e-805b-f9aac69a2709-kube-api-access-94kn6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:06:48.113101 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.113065    5073 generic.go:356] "Generic (PLEG): container finished" podID="b7644ada-8fa5-472e-805b-f9aac69a2709" containerID="60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7" exitCode=0
Oct 30 08:06:48.113314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.113118    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"
Oct 30 08:06:48.113314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.113147    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk" event={"ID":"b7644ada-8fa5-472e-805b-f9aac69a2709","Type":"ContainerDied","Data":"60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7"}
Oct 30 08:06:48.113314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.113211    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk" event={"ID":"b7644ada-8fa5-472e-805b-f9aac69a2709","Type":"ContainerDied","Data":"34e982cbbde712ece560ef5cad5dcbb2d886fae60d13868030fde3ba60099fdd"}
Oct 30 08:06:48.113314 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.113242    5073 scope.go:122] "RemoveContainer" containerID="60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7"
Oct 30 08:06:48.124755 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.124737    5073 scope.go:122] "RemoveContainer" containerID="60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7"
Oct 30 08:06:48.125077 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:06:48.125053    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7\": container with ID starting with 60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7 not found: ID does not exist" containerID="60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7"
Oct 30 08:06:48.125128 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.125089    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7"} err="failed to get container status \"60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7\": rpc error: code = NotFound desc = could not find container \"60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7\": container with ID starting with 60b9103b1c837a8b980b0b516289859053d865a632cfbbf691d6305dd54207c7 not found: ID does not exist"
Oct 30 08:06:48.162425 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.162396    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"]
Oct 30 08:06:48.167148 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:48.167124    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-14271d-778fdd9b64-rwwrk"]
Oct 30 08:06:49.422352 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:49.422313    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7644ada-8fa5-472e-805b-f9aac69a2709" path="/var/lib/kubelet/pods/b7644ada-8fa5-472e-805b-f9aac69a2709/volumes"
Oct 30 08:06:56.601022 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:06:56.600973    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"]
Oct 30 08:07:11.622312 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:11.622267    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main" containerID="cri-o://ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59" gracePeriod=45
Oct 30 08:07:11.885093 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:11.885063    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 08:07:12.029036 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029007    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs\" (UniqueName: \"kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs\") pod \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") "
Oct 30 08:07:12.029222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029073    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm\") pod \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") "
Oct 30 08:07:12.029222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029115    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl\" (UniqueName: \"kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl\") pod \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") "
Oct 30 08:07:12.029222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029150    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir\") pod \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") "
Oct 30 08:07:12.029222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029177    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache\") pod \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") "
Oct 30 08:07:12.029469 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029235    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home\") pod \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\" (UID: \"f80e61c5-c6b3-4471-81b4-4ede125e1b13\") "
Oct 30 08:07:12.029544 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029470    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir" pod "f80e61c5-c6b3-4471-81b4-4ede125e1b13" (UID: "f80e61c5-c6b3-4471-81b4-4ede125e1b13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:12.029544 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029513    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache" pod "f80e61c5-c6b3-4471-81b4-4ede125e1b13" (UID: "f80e61c5-c6b3-4471-81b4-4ede125e1b13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:12.029667 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029651    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home" pod "f80e61c5-c6b3-4471-81b4-4ede125e1b13" (UID: "f80e61c5-c6b3-4471-81b4-4ede125e1b13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:12.029877 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029842    5073 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tmp-dir\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.029968 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029883    5073 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-model-cache\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.029968 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.029899    5073 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-home\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.031264 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.031243    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm" pod "f80e61c5-c6b3-4471-81b4-4ede125e1b13" (UID: "f80e61c5-c6b3-4471-81b4-4ede125e1b13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:12.031361 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.031325    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs" pod "f80e61c5-c6b3-4471-81b4-4ede125e1b13" (UID: "f80e61c5-c6b3-4471-81b4-4ede125e1b13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:12.031403 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.031380    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl" pod "f80e61c5-c6b3-4471-81b4-4ede125e1b13" (UID: "f80e61c5-c6b3-4471-81b4-4ede125e1b13"). InnerVolumeSpecName "kube-api-access-n9tgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:12.131937 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.131898    5073 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80e61c5-c6b3-4471-81b4-4ede125e1b13-tls-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.131937 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.131939    5073 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80e61c5-c6b3-4471-81b4-4ede125e1b13-dshm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.132145 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.131955    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9tgl\" (UniqueName: \"kubernetes.io/projected/f80e61c5-c6b3-4471-81b4-4ede125e1b13-kube-api-access-n9tgl\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.252486 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.252376    5073 generic.go:356] "Generic (PLEG): container finished" podID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerID="ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59" exitCode=0
Oct 30 08:07:12.252845 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.252806    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" event={"ID":"f80e61c5-c6b3-4471-81b4-4ede125e1b13","Type":"ContainerDied","Data":"ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59"}
Oct 30 08:07:12.253016 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.252903    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2" event={"ID":"f80e61c5-c6b3-4471-81b4-4ede125e1b13","Type":"ContainerDied","Data":"c554f56bb8dab1995dce590de9485955d1e5016fa058ce8e664dad0d4b45b2e4"}
Oct 30 08:07:12.253016 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.252933    5073 scope.go:122] "RemoveContainer" containerID="ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59"
Oct 30 08:07:12.253141 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.253055    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"
Oct 30 08:07:12.267153 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.267106    5073 scope.go:122] "RemoveContainer" containerID="ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59"
Oct 30 08:07:12.267657 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:12.267628    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59\": container with ID starting with ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59 not found: ID does not exist" containerID="ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59"
Oct 30 08:07:12.267780 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.267667    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59"} err="failed to get container status \"ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59\": rpc error: code = NotFound desc = could not find container \"ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59\": container with ID starting with ef1fc9f7bdb5f04596a1133784088db2790272c44ba89b557a83e9a87bb88b59 not found: ID does not exist"
Oct 30 08:07:12.312165 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.312128    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"]
Oct 30 08:07:12.313028 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.312971    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" podUID="0222c657-c49a-438d-8ce0-31510447bd8f" containerName="discovery" containerID="cri-o://dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd" gracePeriod=30
Oct 30 08:07:12.322915 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.322884    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"]
Oct 30 08:07:12.325942 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.325886    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-06b26e/simulator-w0-06b26e-kserve-bcfd9d546-66jj2"]
Oct 30 08:07:12.595818 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.595791    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 08:07:12.742041 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742008    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.742536 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742126    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.742536 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742206    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.742536 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742242    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.742536 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742272    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.742536 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742359    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.742536 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.742406    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6\") pod \"0222c657-c49a-438d-8ce0-31510447bd8f\" (UID: \"0222c657-c49a-438d-8ce0-31510447bd8f\") "
Oct 30 08:07:12.743362 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.743317    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:12.745705 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.745679    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:12.746077 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.746051    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:12.746295 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.746268    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:12.746765 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.746738    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:12.746870 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.746766    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "kube-api-access-m4cl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:12.747387 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.747294    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token" pod "0222c657-c49a-438d-8ce0-31510447bd8f" (UID: "0222c657-c49a-438d-8ce0-31510447bd8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:12.843876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843776    5073 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-cacerts\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.843876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843819    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.843876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843836    5073 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0222c657-c49a-438d-8ce0-31510447bd8f-local-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.843876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843863    5073 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-kubeconfig\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.843876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843879    5073 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-ca-configmap\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.844206 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843892    5073 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0222c657-c49a-438d-8ce0-31510447bd8f-istio-csr-dns-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:12.844206 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:12.843906    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4cl6\" (UniqueName: \"kubernetes.io/projected/0222c657-c49a-438d-8ce0-31510447bd8f-kube-api-access-m4cl6\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:13.261822 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.261790    5073 generic.go:356] "Generic (PLEG): container finished" podID="0222c657-c49a-438d-8ce0-31510447bd8f" containerID="dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd" exitCode=0
Oct 30 08:07:13.262012 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.261847    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" event={"ID":"0222c657-c49a-438d-8ce0-31510447bd8f","Type":"ContainerDied","Data":"dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd"}
Oct 30 08:07:13.262012 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.261883    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"
Oct 30 08:07:13.262012 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.261927    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9" event={"ID":"0222c657-c49a-438d-8ce0-31510447bd8f","Type":"ContainerDied","Data":"8e2f07a5650f1e30900d0a5a05cb01d10848cf59f188bc52255a77382a9d2442"}
Oct 30 08:07:13.262012 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.261961    5073 scope.go:122] "RemoveContainer" containerID="dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd"
Oct 30 08:07:13.272180 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.272159    5073 scope.go:122] "RemoveContainer" containerID="dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd"
Oct 30 08:07:13.272528 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:13.272504    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd\": container with ID starting with dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd not found: ID does not exist" containerID="dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd"
Oct 30 08:07:13.272590 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.272541    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd"} err="failed to get container status \"dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd\": rpc error: code = NotFound desc = could not find container \"dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd\": container with ID starting with dc4072622570e61617a8355b0c81287d7f160888388942ae1af8a65f5cd0cafd not found: ID does not exist"
Oct 30 08:07:13.335185 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.335149    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"]
Oct 30 08:07:13.352028 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.351997    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qftw9"]
Oct 30 08:07:13.422662 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.422625    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0222c657-c49a-438d-8ce0-31510447bd8f" path="/var/lib/kubelet/pods/0222c657-c49a-438d-8ce0-31510447bd8f/volumes"
Oct 30 08:07:13.423136 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:13.423121    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" path="/var/lib/kubelet/pods/f80e61c5-c6b3-4471-81b4-4ede125e1b13/volumes"
Oct 30 08:07:13.924825 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:13.924790    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:07:18.621153 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:18.621115    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"]
Oct 30 08:07:18.621153 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:18.621441    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" podUID="0a8643da-27a9-430f-a5c9-9fc8e6021c35" containerName="maas-api" containerID="cri-o://cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040" gracePeriod=30
Oct 30 08:07:18.886665 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:18.886635    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 08:07:19.015963 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.015915    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\") pod \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") "
Oct 30 08:07:19.016155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.015986    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt\" (UniqueName: \"kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt\") pod \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") "
Oct 30 08:07:19.016155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.016113    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs\") pod \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") "
Oct 30 08:07:19.016281 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.016218    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca\") pod \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\" (UID: \"0a8643da-27a9-430f-a5c9-9fc8e6021c35\") "
Oct 30 08:07:19.017679 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.016598    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca" pod "0a8643da-27a9-430f-a5c9-9fc8e6021c35" (UID: "0a8643da-27a9-430f-a5c9-9fc8e6021c35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:19.017679 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.016727    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a8643da-27a9-430f-a5c9-9fc8e6021c35-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:19.018358 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.018325    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs" pod "0a8643da-27a9-430f-a5c9-9fc8e6021c35" (UID: "0a8643da-27a9-430f-a5c9-9fc8e6021c35"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:19.018463 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.018357    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt" pod "0a8643da-27a9-430f-a5c9-9fc8e6021c35" (UID: "0a8643da-27a9-430f-a5c9-9fc8e6021c35"). InnerVolumeSpecName "kube-api-access-z4ldt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:19.018634 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.018600    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls" pod "0a8643da-27a9-430f-a5c9-9fc8e6021c35" (UID: "0a8643da-27a9-430f-a5c9-9fc8e6021c35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:19.118014 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.117971    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:19.118014 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.118006    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a8643da-27a9-430f-a5c9-9fc8e6021c35-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:19.118014 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.118020    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4ldt\" (UniqueName: \"kubernetes.io/projected/0a8643da-27a9-430f-a5c9-9fc8e6021c35-kube-api-access-z4ldt\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:19.303142 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.303028    5073 generic.go:356] "Generic (PLEG): container finished" podID="0a8643da-27a9-430f-a5c9-9fc8e6021c35" containerID="cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040" exitCode=0
Oct 30 08:07:19.303142 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.303088    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" event={"ID":"0a8643da-27a9-430f-a5c9-9fc8e6021c35","Type":"ContainerDied","Data":"cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040"}
Oct 30 08:07:19.303142 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.303116    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"
Oct 30 08:07:19.303423 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.303156    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z" event={"ID":"0a8643da-27a9-430f-a5c9-9fc8e6021c35","Type":"ContainerDied","Data":"165bcdb32c726c713fc0385486324feaec3915414540d89cfd8c043eb051b913"}
Oct 30 08:07:19.303423 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.303188    5073 scope.go:122] "RemoveContainer" containerID="cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040"
Oct 30 08:07:19.314460 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.314435    5073 scope.go:122] "RemoveContainer" containerID="cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040"
Oct 30 08:07:19.314762 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:19.314745    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040\": container with ID starting with cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040 not found: ID does not exist" containerID="cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040"
Oct 30 08:07:19.314814 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.314770    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040"} err="failed to get container status \"cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040\": rpc error: code = NotFound desc = could not find container \"cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040\": container with ID starting with cbe2fdaa38a44bd0ac7c4c87ca03bb899de28fd8328418eeb1278bd6e3358040 not found: ID does not exist"
Oct 30 08:07:19.353590 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.353560    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"]
Oct 30 08:07:19.364635 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.364610    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-06b26e-546c58465d-fp75z"]
Oct 30 08:07:19.427767 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:19.427728    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a8643da-27a9-430f-a5c9-9fc8e6021c35" path="/var/lib/kubelet/pods/0a8643da-27a9-430f-a5c9-9fc8e6021c35/volumes"
Oct 30 08:07:27.272338 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:27.272143    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"]
Oct 30 08:07:27.273036 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:27.272428    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy" containerID="cri-o://f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4" gracePeriod=30
Oct 30 08:07:32.145774 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.145738    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"]
Oct 30 08:07:32.181490 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.181457    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"]
Oct 30 08:07:32.566177 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.566143    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 08:07:32.663528 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663453    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663528 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663501    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663535    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663581    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663815 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663727    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663815 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663795    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663979 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663830    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.663979 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663888    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:32.663979 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663899    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:32.663979 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.663901    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.664173 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664011    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo\") pod \"dedb5615-f04f-4645-beea-400df984421d\" (UID: \"dedb5615-f04f-4645-beea-400df984421d\") "
Oct 30 08:07:32.664173 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664031    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:32.664173 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664076    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:32.664297 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664270    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:32.664447 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664426    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.664506 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664451    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.664506 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664466    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.664506 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664480    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.664506 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.664495    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dedb5615-f04f-4645-beea-400df984421d-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.665736 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.665713    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:32.665896 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.665759    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:32.666080 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.666063    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "kube-api-access-gpwth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:32.666274 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.666260    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo" pod "dedb5615-f04f-4645-beea-400df984421d" (UID: "dedb5615-f04f-4645-beea-400df984421d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:07:32.766009 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.765977    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpwth\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-kube-api-access-gpwth\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.766009 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.766004    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dedb5615-f04f-4645-beea-400df984421d-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.766009 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.766015    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dedb5615-f04f-4645-beea-400df984421d-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:32.766247 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:32.766023    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dedb5615-f04f-4645-beea-400df984421d-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:33.383838 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.383803    5073 generic.go:356] "Generic (PLEG): container finished" podID="dedb5615-f04f-4645-beea-400df984421d" containerID="f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4" exitCode=0
Oct 30 08:07:33.384229 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.383963    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" event={"ID":"dedb5615-f04f-4645-beea-400df984421d","Type":"ContainerDied","Data":"f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4"}
Oct 30 08:07:33.384229 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.384003    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs" event={"ID":"dedb5615-f04f-4645-beea-400df984421d","Type":"ContainerDied","Data":"06d098136e7db36db42b2e70b77fa14a54c876846d8150e6e0da4b2754eb300a"}
Oct 30 08:07:33.384229 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.384023    5073 scope.go:122] "RemoveContainer" containerID="f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4"
Oct 30 08:07:33.384229 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.384141    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"
Oct 30 08:07:33.394879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.394843    5073 scope.go:122] "RemoveContainer" containerID="f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4"
Oct 30 08:07:33.395133 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:33.395117    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4\": container with ID starting with f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4 not found: ID does not exist" containerID="f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4"
Oct 30 08:07:33.395185 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.395141    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4"} err="failed to get container status \"f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4\": rpc error: code = NotFound desc = could not find container \"f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4\": container with ID starting with f62ac589d4f7b66ce8fadc1dba334dfd71b767721fc80025e0b5e65570fc95f4 not found: ID does not exist"
Oct 30 08:07:33.446884 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.446836    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"]
Oct 30 08:07:33.458447 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.458402    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-06b26e-openshift-default-76cd74f47-lbfqs"]
Oct 30 08:07:33.601975 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.601943    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"]
Oct 30 08:07:33.602167 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:33.602141    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy" containerID="cri-o://803819e2cc06785781929866371e448d1750fadb46091d6334d54b6318826b4b" gracePeriod=30
Oct 30 08:07:35.249778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.249745    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"]
Oct 30 08:07:35.250465 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250443    5073 cpu_manager.go:414] "containerMap: removing container" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250467    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250483    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250490    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250504    5073 cpu_manager.go:414] "containerMap: removing container" podUID="a9f962fc-0cec-4652-b269-db7a6b81d5e6" containerName="maas-api"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250511    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9f962fc-0cec-4652-b269-db7a6b81d5e6" containerName="maas-api"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250526    5073 cpu_manager.go:414] "containerMap: removing container" podUID="489af737-000c-44b6-8555-7337428ebe7b" containerName="maas-api"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250534    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="489af737-000c-44b6-8555-7337428ebe7b" containerName="maas-api"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250547    5073 cpu_manager.go:414] "containerMap: removing container" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250554    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250562    5073 cpu_manager.go:414] "containerMap: removing container" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250569    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250580    5073 cpu_manager.go:414] "containerMap: removing container" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250588    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy"
Oct 30 08:07:35.250593 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250597    5073 cpu_manager.go:414] "containerMap: removing container" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250604    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250621    5073 cpu_manager.go:414] "containerMap: removing container" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250630    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250643    5073 cpu_manager.go:414] "containerMap: removing container" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250650    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250663    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250670    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250684    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250691    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250700    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250708    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250721    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250728    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250742    5073 cpu_manager.go:414] "containerMap: removing container" podUID="3fc3a39e-055b-45ca-8c6f-02f8ca34532d" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250749    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fc3a39e-055b-45ca-8c6f-02f8ca34532d" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250760    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250767    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250779    5073 cpu_manager.go:414] "containerMap: removing container" podUID="0222c657-c49a-438d-8ce0-31510447bd8f" containerName="discovery"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250786    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0222c657-c49a-438d-8ce0-31510447bd8f" containerName="discovery"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250795    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5ec7a1d4-269e-43f9-884a-6e505aee95a8" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250802    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ec7a1d4-269e-43f9-884a-6e505aee95a8" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250811    5073 cpu_manager.go:414] "containerMap: removing container" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250819    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250830    5073 cpu_manager.go:414] "containerMap: removing container" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250837    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250848    5073 cpu_manager.go:414] "containerMap: removing container" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250869    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250883    5073 cpu_manager.go:414] "containerMap: removing container" podUID="69ac61ee-4295-47b7-b71a-939a37cb3d39" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250891    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69ac61ee-4295-47b7-b71a-939a37cb3d39" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250903    5073 cpu_manager.go:414] "containerMap: removing container" podUID="299c5545-17b6-4d86-b3de-84ef840a9228" containerName="payload-processing"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250911    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="299c5545-17b6-4d86-b3de-84ef840a9228" containerName="payload-processing"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250922    5073 cpu_manager.go:414] "containerMap: removing container" podUID="90aae629-aa1b-47a8-9175-ed746e57fe00" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250930    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90aae629-aa1b-47a8-9175-ed746e57fe00" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250942    5073 cpu_manager.go:414] "containerMap: removing container" podUID="75931c81-5679-447e-bdb2-d29caf32830b" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250949    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75931c81-5679-447e-bdb2-d29caf32830b" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250961    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250967    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250981    5073 cpu_manager.go:414] "containerMap: removing container" podUID="0a8643da-27a9-430f-a5c9-9fc8e6021c35" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.250989    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a8643da-27a9-430f-a5c9-9fc8e6021c35" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251004    5073 cpu_manager.go:414] "containerMap: removing container" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251011    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251020    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251027    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251044    5073 cpu_manager.go:414] "containerMap: removing container" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251051    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251063    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251071    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251086    5073 cpu_manager.go:414] "containerMap: removing container" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251093    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251106    5073 cpu_manager.go:414] "containerMap: removing container" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251114    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251125    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ad813659-e8b5-47f0-b5c7-4fbc76dc377e" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251132    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad813659-e8b5-47f0-b5c7-4fbc76dc377e" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251146    5073 cpu_manager.go:414] "containerMap: removing container" podUID="b7644ada-8fa5-472e-805b-f9aac69a2709" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251153    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7644ada-8fa5-472e-805b-f9aac69a2709" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251165    5073 cpu_manager.go:414] "containerMap: removing container" podUID="86e64f24-1e24-46b6-a554-671fd4a040a2" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251173    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86e64f24-1e24-46b6-a554-671fd4a040a2" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251184    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251191    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251205    5073 cpu_manager.go:414] "containerMap: removing container" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251212    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251225    5073 cpu_manager.go:414] "containerMap: removing container" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251233    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251245    5073 cpu_manager.go:414] "containerMap: removing container" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251251    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251263    5073 cpu_manager.go:414] "containerMap: removing container" podUID="2ef277a0-b7d4-4882-9adb-309a713ccb74" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251270    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ef277a0-b7d4-4882-9adb-309a713ccb74" containerName="maas-api"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251281    5073 cpu_manager.go:414] "containerMap: removing container" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251288    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251300    5073 cpu_manager.go:414] "containerMap: removing container" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy"
Oct 30 08:07:35.251365 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251307    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251438    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251453    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251465    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef4356d8-2dd5-4e7e-8e53-98a37f7e4f36" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251476    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fc3a39e-055b-45ca-8c6f-02f8ca34532d" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251486    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251494    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="0222c657-c49a-438d-8ce0-31510447bd8f" containerName="discovery"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251504    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ec7a1d4-269e-43f9-884a-6e505aee95a8" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251512    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d444b8a-2478-4417-9cc9-be7f4a4d242c" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251520    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251529    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251537    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251546    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="69ac61ee-4295-47b7-b71a-939a37cb3d39" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251554    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="299c5545-17b6-4d86-b3de-84ef840a9228" containerName="payload-processing"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251561    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="90aae629-aa1b-47a8-9175-ed746e57fe00" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251572    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="75931c81-5679-447e-bdb2-d29caf32830b" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251580    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251589    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a8643da-27a9-430f-a5c9-9fc8e6021c35" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251598    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="f691d503-b3ce-4587-83b9-99bf39214197" containerName="main"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251606    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251617    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9d19ace-9eac-41c4-b167-d496d4ca74b8" containerName="main"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251625    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="0491151e-4c57-4f97-a109-0f9c41917f82" containerName="payload-processing"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251633    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251643    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="58d2e1af-ea71-4540-b85c-158dca17fa50" containerName="payload-pre-processing"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251653    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251662    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad813659-e8b5-47f0-b5c7-4fbc76dc377e" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251673    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7644ada-8fa5-472e-805b-f9aac69a2709" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251681    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="86e64f24-1e24-46b6-a554-671fd4a040a2" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251690    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251698    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251707    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="f80e61c5-c6b3-4471-81b4-4ede125e1b13" containerName="main"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251716    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc8b0807-15b2-4029-919d-7c265542f8d8" containerName="main"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251725    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ef277a0-b7d4-4882-9adb-309a713ccb74" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251733    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251743    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bcd81d7-90ea-4b8b-a74a-1e8ad3ed862d" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251753    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251762    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9f962fc-0cec-4652-b269-db7a6b81d5e6" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251771    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="489af737-000c-44b6-8555-7337428ebe7b" containerName="maas-api"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251779    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="dedb5615-f04f-4645-beea-400df984421d" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251790    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="fee496f0-8439-4d38-8b30-59be3c7fbd34" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251802    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="96809b63-5022-485a-a1cf-24f47bd96f44" containerName="istio-proxy"
Oct 30 08:07:35.254284 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.251810    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d98e771-de3f-40d3-83be-e3ed54995a3d" containerName="main"
Oct 30 08:07:35.256896 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.256877    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.287269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.287245    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 08:07:35.287584 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.287567    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9pb7\""
Oct 30 08:07:35.294065 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.294041    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zp78\" (UniqueName: \"kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.294198 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.294077    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.294274 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.294246    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.301272 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.301241    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"]
Oct 30 08:07:35.395034 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.395002    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zp78\" (UniqueName: \"kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.395211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.395046    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.395211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.395087    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.395778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.395748    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.397493 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.397461    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.421225 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.421191    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dedb5615-f04f-4645-beea-400df984421d" path="/var/lib/kubelet/pods/dedb5615-f04f-4645-beea-400df984421d/volumes"
Oct 30 08:07:35.421688 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.421668    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zp78\" (UniqueName: \"kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78\") pod \"maas-api-revoke-sub-0ca56cac-h5pqr\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.569823 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.569744    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:35.879781 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:35.879755    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"]
Oct 30 08:07:35.881077 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:07:35.881051    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5ce8a5_bd3d_4e2f_b12e_081eedb7be27.slice/crio-5a259f9afd9651391559e8d2e521b5e3ca2df6168b41bc2b2a53fa83dc73d460 WatchSource:0}: Error finding container 5a259f9afd9651391559e8d2e521b5e3ca2df6168b41bc2b2a53fa83dc73d460: Status 404 returned error can't find the container with id 5a259f9afd9651391559e8d2e521b5e3ca2df6168b41bc2b2a53fa83dc73d460
Oct 30 08:07:36.406298 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:36.406261    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr" event={"ID":"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27","Type":"ContainerStarted","Data":"2ba6515e918e9a2d3af8aff1d1d803caebe4e132c3db2188a23fadcbe59e97f0"}
Oct 30 08:07:36.406657 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:36.406329    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr" event={"ID":"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27","Type":"ContainerStarted","Data":"5a259f9afd9651391559e8d2e521b5e3ca2df6168b41bc2b2a53fa83dc73d460"}
Oct 30 08:07:36.451272 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:36.451173    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr" podStartSLOduration=1.451159802 podStartE2EDuration="1.451159802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:07:36.449722899 +0000 UTC m=+4259.157603081" watchObservedRunningTime="2026-10-30 08:07:36.451159802 +0000 UTC m=+4259.159040007"
Oct 30 08:07:37.146687 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:37.146641    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" podUID="ae630470-cbef-4780-9df6-27f416319e22" containerName="payload-processing" containerID="cri-o://824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4" gracePeriod=25
Oct 30 08:07:37.378155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:37.378091    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" containerName="payload-pre-processing" containerID="cri-o://4257121a21e705558c60db2404231aef689fb3fc4abf259bc5c04ea038f55cfa" gracePeriod=25
Oct 30 08:07:37.413443 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:37.413374    5073 generic.go:356] "Generic (PLEG): container finished" podID="0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" containerID="2ba6515e918e9a2d3af8aff1d1d803caebe4e132c3db2188a23fadcbe59e97f0" exitCode=0
Oct 30 08:07:37.413781 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:37.413468    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr" event={"ID":"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27","Type":"ContainerDied","Data":"2ba6515e918e9a2d3af8aff1d1d803caebe4e132c3db2188a23fadcbe59e97f0"}
Oct 30 08:07:38.559628 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.559604    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:38.633703 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.633671    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca\") pod \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") "
Oct 30 08:07:38.633899 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.633743    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca\") pod \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") "
Oct 30 08:07:38.633899 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.633829    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78\" (UniqueName: \"kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78\") pod \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\" (UID: \"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27\") "
Oct 30 08:07:38.634152 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.634130    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca" pod "0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" (UID: "0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:38.634369 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.634348    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-openshift-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:38.636178 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.636152    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78" pod "0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" (UID: "0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27"). InnerVolumeSpecName "kube-api-access-5zp78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:38.636656 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.636632    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca" pod "0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" (UID: "0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:38.735734 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.735702    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zp78\" (UniqueName: \"kubernetes.io/projected/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-kube-api-access-5zp78\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:38.735734 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.735734    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27-maas-api-xks-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:38.855211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.855187    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 08:07:38.937957 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.937924    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938135 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.937978    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938135 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938013    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938135 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938034    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938135 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938054    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938135 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938098    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938180    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938208    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938257    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket\") pod \"5b319eba-a57f-4c02-8363-d21fa255f4e2\" (UID: \"5b319eba-a57f-4c02-8363-d21fa255f4e2\") "
Oct 30 08:07:38.938433 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938370    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:38.938641 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938579    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:38.938641 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938591    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:38.938747 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938709    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:38.938747 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938717    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:38.938894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938759    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:38.938894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938773    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:38.938894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.938784    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:38.940487 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.940461    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:07:38.940594 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.940489    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:07:38.940594 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.940570    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "kube-api-access-dwdv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:38.940828 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:38.940815    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token" pod "5b319eba-a57f-4c02-8363-d21fa255f4e2" (UID: "5b319eba-a57f-4c02-8363-d21fa255f4e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:39.039863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.039779    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:39.039863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.039803    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:39.039863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.039813    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:39.039863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.039822    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwdv2\" (UniqueName: \"kubernetes.io/projected/5b319eba-a57f-4c02-8363-d21fa255f4e2-kube-api-access-dwdv2\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:39.039863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.039845    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b319eba-a57f-4c02-8363-d21fa255f4e2-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:39.039863 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.039868    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b319eba-a57f-4c02-8363-d21fa255f4e2-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:39.389662 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.389626    5073 scope.go:122] "RemoveContainer" containerID="803819e2cc06785781929866371e448d1750fadb46091d6334d54b6318826b4b"
Oct 30 08:07:39.433463 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.428406    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" event={"ID":"5b319eba-a57f-4c02-8363-d21fa255f4e2","Type":"ContainerDied","Data":"803819e2cc06785781929866371e448d1750fadb46091d6334d54b6318826b4b"}
Oct 30 08:07:39.433463 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.428535    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"
Oct 30 08:07:39.433463 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.432332    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd" event={"ID":"5b319eba-a57f-4c02-8363-d21fa255f4e2","Type":"ContainerDied","Data":"d67bb40e56036ce7d0eac3267b22458b6cbbf09d322a7924e1db47f8069bc363"}
Oct 30 08:07:39.443603 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.443549    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr" event={"ID":"0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27","Type":"ContainerDied","Data":"5a259f9afd9651391559e8d2e521b5e3ca2df6168b41bc2b2a53fa83dc73d460"}
Oct 30 08:07:39.443889 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.443619    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0ca56cac-h5pqr"
Oct 30 08:07:39.443889 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.443626    5073 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a259f9afd9651391559e8d2e521b5e3ca2df6168b41bc2b2a53fa83dc73d460"
Oct 30 08:07:39.518432 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.518396    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"]
Oct 30 08:07:39.538001 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:39.537968    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-679fd"]
Oct 30 08:07:41.421206 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:41.421172    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" path="/var/lib/kubelet/pods/5b319eba-a57f-4c02-8363-d21fa255f4e2/volumes"
Oct 30 08:07:43.922181 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:43.922142    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:07:45.057480 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:45.057439    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" podUID="ae630470-cbef-4780-9df6-27f416319e22" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:07:45.057480 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:45.057466    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:07:50.351401 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.351305    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"]
Oct 30 08:07:50.352027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.351529    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" podUID="e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" containerName="maas-api" containerID="cri-o://002162a5f3077e2e0ed97fe583932e93cedf14afd627a7c898a9a55d20ab4adb" gracePeriod=30
Oct 30 08:07:50.507326 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.507290    5073 generic.go:356] "Generic (PLEG): container finished" podID="e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" containerID="002162a5f3077e2e0ed97fe583932e93cedf14afd627a7c898a9a55d20ab4adb" exitCode=0
Oct 30 08:07:50.507522 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.507425    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" event={"ID":"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c","Type":"ContainerDied","Data":"002162a5f3077e2e0ed97fe583932e93cedf14afd627a7c898a9a55d20ab4adb"}
Oct 30 08:07:50.613512 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.613452    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 08:07:50.766166 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.766133    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs\") pod \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") "
Oct 30 08:07:50.766322 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.766231    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7\" (UniqueName: \"kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7\") pod \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") "
Oct 30 08:07:50.766387 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.766329    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\") pod \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") "
Oct 30 08:07:50.766447 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.766391    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca\") pod \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\" (UID: \"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c\") "
Oct 30 08:07:50.766895 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.766813    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca" pod "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" (UID: "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:50.768355 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.768329    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls" pod "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" (UID: "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:50.768475 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.768366    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7" pod "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" (UID: "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c"). InnerVolumeSpecName "kube-api-access-q9lb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:50.768475 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.768386    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs" pod "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" (UID: "e5b7e8c1-7376-4769-a059-4dd6d12b7d0c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 08:07:50.867596 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.867501    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9lb7\" (UniqueName: \"kubernetes.io/projected/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-kube-api-access-q9lb7\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:50.867596 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.867537    5073 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-maas-api-tls\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:50.867596 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.867550    5073 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-openshift-service-ca\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:50.867596 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:50.867561    5073 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c-metrics-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:51.513966 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:51.513936    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"
Oct 30 08:07:51.514390 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:51.513934    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl" event={"ID":"e5b7e8c1-7376-4769-a059-4dd6d12b7d0c","Type":"ContainerDied","Data":"c325a7011ff3d490ca24f575736ce2c23899fd1e00c52bd8783c074d33fd1321"}
Oct 30 08:07:51.514390 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:51.514079    5073 scope.go:122] "RemoveContainer" containerID="002162a5f3077e2e0ed97fe583932e93cedf14afd627a7c898a9a55d20ab4adb"
Oct 30 08:07:51.562938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:51.562913    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"]
Oct 30 08:07:51.574574 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:51.574550    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2eda2c-5667b88695-58zwl"]
Oct 30 08:07:53.420977 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:53.420942    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" path="/var/lib/kubelet/pods/e5b7e8c1-7376-4769-a059-4dd6d12b7d0c/volumes"
Oct 30 08:07:54.088430 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.088398    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"]
Oct 30 08:07:54.089017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.088995    5073 cpu_manager.go:414] "containerMap: removing container" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:54.089017 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089015    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089033    5073 cpu_manager.go:414] "containerMap: removing container" podUID="0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" containerName="revoke-keys"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089038    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" containerName="revoke-keys"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089051    5073 cpu_manager.go:414] "containerMap: removing container" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089055    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089073    5073 cpu_manager.go:414] "containerMap: removing container" podUID="e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" containerName="maas-api"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089078    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" containerName="maas-api"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089087    5073 cpu_manager.go:414] "containerMap: removing container" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089092    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40daf937-243d-4106-8b1b-fbeb5077765c" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089108    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089112    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089124    5073 cpu_manager.go:414] "containerMap: removing container" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089129    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5741efea-b1a0-4c80-9eeb-1f16d857f872" containerName="cleanup"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089211    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f91f18b-c52a-49be-ae98-41f3a4d3d401" containerName="istio-proxy"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089223    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="3bbdbbf4-f026-4db8-90fc-026829ded1af" containerName="cleanup"
Oct 30 08:07:54.089222 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089230    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c96d9c-7d64-4bb2-ade2-92d5a3fc283e" containerName="istio-proxy"
Oct 30 08:07:54.089778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089238    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5b7e8c1-7376-4769-a059-4dd6d12b7d0c" containerName="maas-api"
Oct 30 08:07:54.089778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089246    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b319eba-a57f-4c02-8363-d21fa255f4e2" containerName="istio-proxy"
Oct 30 08:07:54.089778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089253    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e8f8ad1-7d95-48e4-95f0-cd2b71078e23" containerName="istio-proxy"
Oct 30 08:07:54.089778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089261    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa733e26-9561-4b9c-a4eb-5ac0e927245b" containerName="istio-proxy"
Oct 30 08:07:54.089778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089266    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27" containerName="revoke-keys"
Oct 30 08:07:54.089778 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.089272    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cfdf133-238b-40f6-ac16-5edd894148a8" containerName="cleanup"
Oct 30 08:07:54.094127 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.094105    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.115416 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.115395    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-2eda2c-openshift-default-dockercfg-bdk2w\""
Oct 30 08:07:54.125312 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.125286    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"]
Oct 30 08:07:54.203688 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.203651    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.203879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.203698    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.203879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.203731    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.203879 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.203761    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.204027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.203968    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.204027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.204021    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.204168 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.204146    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59vv\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.204211 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.204177    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.204254 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.204210    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.305628 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305588    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.305811 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305706    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.305811 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305758    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.305811 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305801    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59vv\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306038 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305825    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306038 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305892    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306038 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305933    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306038 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305960    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306038 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.305983    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306296 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.306045    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306357 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.306310    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306357 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.306339    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306471 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.306433    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.306655 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.306635    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.308143 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.308119    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.308513 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.308492    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.328774 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.328747    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.328941 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.328924    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59vv\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv\") pod \"e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") " pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.409126 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.409098    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:54.727799 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.727768    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"]
Oct 30 08:07:54.729396 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:07:54.729369    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb48a5f8_05d4_4e81_ac42_54fb322a1184.slice/crio-6392118b061024e824ddb000c911afc01002f4e3767dc1b6bde6d7730a4daf9d WatchSource:0}: Error finding container 6392118b061024e824ddb000c911afc01002f4e3767dc1b6bde6d7730a4daf9d: Status 404 returned error can't find the container with id 6392118b061024e824ddb000c911afc01002f4e3767dc1b6bde6d7730a4daf9d
Oct 30 08:07:54.731554 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.731524    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 08:07:54.731611 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.731586    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 08:07:54.731654 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:54.731635    5073 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 08:07:55.056610 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:55.056530    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" podUID="ae630470-cbef-4780-9df6-27f416319e22" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:07:55.056610 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:55.056560    5073 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 08:07:55.545935 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:55.545897    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" event={"ID":"bb48a5f8-05d4-4e81-ac42-54fb322a1184","Type":"ContainerStarted","Data":"5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc"}
Oct 30 08:07:55.546116 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:55.545955    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" event={"ID":"bb48a5f8-05d4-4e81-ac42-54fb322a1184","Type":"ContainerStarted","Data":"6392118b061024e824ddb000c911afc01002f4e3767dc1b6bde6d7730a4daf9d"}
Oct 30 08:07:55.613318 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:55.613252    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" podStartSLOduration=1.61323314 podStartE2EDuration="1.61323314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:07:55.601371278 +0000 UTC m=+4278.309251447" watchObservedRunningTime="2026-10-30 08:07:55.61323314 +0000 UTC m=+4278.321113310"
Oct 30 08:07:56.409507 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:56.409473    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:56.414876 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:56.414824    5073 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:56.551072 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:56.551043    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:56.552100 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:56.552077    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:07:57.470426 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.470397    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 08:07:57.560656 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.560620    5073 generic.go:356] "Generic (PLEG): container finished" podID="ae630470-cbef-4780-9df6-27f416319e22" containerID="824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4" exitCode=0
Oct 30 08:07:57.560815 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.560718    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"
Oct 30 08:07:57.560815 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.560755    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" event={"ID":"ae630470-cbef-4780-9df6-27f416319e22","Type":"ContainerDied","Data":"824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4"}
Oct 30 08:07:57.560959 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.560817    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm" event={"ID":"ae630470-cbef-4780-9df6-27f416319e22","Type":"ContainerDied","Data":"5e74dc3359ea8ce9919f3167c9a8d9a002cc1c91d27e033e9e4b4254a34be6aa"}
Oct 30 08:07:57.560959 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.560878    5073 scope.go:122] "RemoveContainer" containerID="824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4"
Oct 30 08:07:57.562648 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.562629    5073 generic.go:356] "Generic (PLEG): container finished" podID="87421966-6131-48eb-a611-d1ac76a0d19f" containerID="4257121a21e705558c60db2404231aef689fb3fc4abf259bc5c04ea038f55cfa" exitCode=0
Oct 30 08:07:57.562746 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.562674    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" event={"ID":"87421966-6131-48eb-a611-d1ac76a0d19f","Type":"ContainerDied","Data":"4257121a21e705558c60db2404231aef689fb3fc4abf259bc5c04ea038f55cfa"}
Oct 30 08:07:57.573699 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.573678    5073 scope.go:122] "RemoveContainer" containerID="824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4"
Oct 30 08:07:57.574111 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:07:57.574085    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4\": container with ID starting with 824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4 not found: ID does not exist" containerID="824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4"
Oct 30 08:07:57.574221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.574121    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4"} err="failed to get container status \"824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4\": rpc error: code = NotFound desc = could not find container \"824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4\": container with ID starting with 824b8466b9d7852166b67fd1107f9544f7c49512c0b48c50b9379d51723bcad4 not found: ID does not exist"
Oct 30 08:07:57.644105 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.644071    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume\") pod \"ae630470-cbef-4780-9df6-27f416319e22\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") "
Oct 30 08:07:57.644245 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.644158    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw\" (UniqueName: \"kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw\") pod \"ae630470-cbef-4780-9df6-27f416319e22\" (UID: \"ae630470-cbef-4780-9df6-27f416319e22\") "
Oct 30 08:07:57.644590 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.644567    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume" pod "ae630470-cbef-4780-9df6-27f416319e22" (UID: "ae630470-cbef-4780-9df6-27f416319e22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:57.646317 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.646297    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw" pod "ae630470-cbef-4780-9df6-27f416319e22" (UID: "ae630470-cbef-4780-9df6-27f416319e22"). InnerVolumeSpecName "kube-api-access-x7wnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:57.661602 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.661556    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 08:07:57.745446 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.745415    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae630470-cbef-4780-9df6-27f416319e22-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:57.745446 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.745442    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7wnw\" (UniqueName: \"kubernetes.io/projected/ae630470-cbef-4780-9df6-27f416319e22-kube-api-access-x7wnw\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:57.846503 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.846469    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume\") pod \"87421966-6131-48eb-a611-d1ac76a0d19f\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") "
Oct 30 08:07:57.846691 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.846510    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm\" (UniqueName: \"kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm\") pod \"87421966-6131-48eb-a611-d1ac76a0d19f\" (UID: \"87421966-6131-48eb-a611-d1ac76a0d19f\") "
Oct 30 08:07:57.846908 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.846881    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume" pod "87421966-6131-48eb-a611-d1ac76a0d19f" (UID: "87421966-6131-48eb-a611-d1ac76a0d19f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:07:57.848526 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.848505    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm" pod "87421966-6131-48eb-a611-d1ac76a0d19f" (UID: "87421966-6131-48eb-a611-d1ac76a0d19f"). InnerVolumeSpecName "kube-api-access-drqmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:07:57.907301 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.907270    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"]
Oct 30 08:07:57.913084 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.913006    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2eda2c-5bf44f7f98-49qqm"]
Oct 30 08:07:57.948104 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.948074    5073 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87421966-6131-48eb-a611-d1ac76a0d19f-plugins-config-volume\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:57.948104 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:57.948098    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drqmm\" (UniqueName: \"kubernetes.io/projected/87421966-6131-48eb-a611-d1ac76a0d19f-kube-api-access-drqmm\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:07:58.304784 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.304702    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"]
Oct 30 08:07:58.569797 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.569724    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"
Oct 30 08:07:58.569797 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.569765    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf" event={"ID":"87421966-6131-48eb-a611-d1ac76a0d19f","Type":"ContainerDied","Data":"454b394f5d49460af46523c426d6f40f5acd419d69734c1ebbae00b3b9beaebb"}
Oct 30 08:07:58.570350 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.569816    5073 scope.go:122] "RemoveContainer" containerID="4257121a21e705558c60db2404231aef689fb3fc4abf259bc5c04ea038f55cfa"
Oct 30 08:07:58.570350 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.570154    5073 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" secret="" err="secret \"e2e-worker-w3-2eda2c-openshift-default-dockercfg-bdk2w\" not found"
Oct 30 08:07:58.618605 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.618573    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"]
Oct 30 08:07:58.625227 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:58.625194    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2eda2c-d7f489bf5-7n6zf"]
Oct 30 08:07:59.421786 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:59.421751    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" path="/var/lib/kubelet/pods/87421966-6131-48eb-a611-d1ac76a0d19f/volumes"
Oct 30 08:07:59.422215 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:59.422191    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae630470-cbef-4780-9df6-27f416319e22" path="/var/lib/kubelet/pods/ae630470-cbef-4780-9df6-27f416319e22/volumes"
Oct 30 08:07:59.476495 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:59.476469    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9d797f85-rbbws_391cc1a6-2092-4420-87db-4dca9e49d66a/authorino/0.log"
Oct 30 08:07:59.575737 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:59.575687    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" podUID="bb48a5f8-05d4-4e81-ac42-54fb322a1184" containerName="istio-proxy" containerID="cri-o://5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc" gracePeriod=30
Oct 30 08:07:59.718198 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:07:59.718118    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-rv7dp_caa1fc89-9fb3-4d05-b054-e3654712df59/manager/0.log"
Oct 30 08:08:02.004543 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:02.004502    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-jnpp6_c3a16aa5-0190-4e9c-ab94-415c993ebc77/manager/0.log"
Oct 30 08:08:03.374495 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:03.374465    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:08:03.596407 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:03.596358    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:08:04.837393 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.837366    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:08:04.912585 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912552    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.912791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912610    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.912791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912660    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.912791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912699    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.912791 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912770    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.913096 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912809    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.913096 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912935    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.913096 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.912969    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.913096 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.913019    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert\") pod \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\" (UID: \"bb48a5f8-05d4-4e81-ac42-54fb322a1184\") "
Oct 30 08:08:04.913404 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.913374    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:08:04.913845 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.913638    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:08:04.913845 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.913689    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:08:04.913845 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.913662    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:08:04.913845 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.913753    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:08:04.916297 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.916266    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:08:04.916405 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.916384    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "kube-api-access-m59vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:08:04.916499 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.916478    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:08:04.924186 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.924157    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo" pod "bb48a5f8-05d4-4e81-ac42-54fb322a1184" (UID: "bb48a5f8-05d4-4e81-ac42-54fb322a1184"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:08:04.966333 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:04.966303    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:08:05.014279 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014245    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014279 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014278    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014292    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014306    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014318    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014330    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m59vv\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-kube-api-access-m59vv\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014343    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb48a5f8-05d4-4e81-ac42-54fb322a1184-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014355    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.014511 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.014366    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb48a5f8-05d4-4e81-ac42-54fb322a1184-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:08:05.166386 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.166311    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zw8zl_d108dffa-e8c2-449f-bd16-cf71ec233d84/manager/0.log"
Oct 30 08:08:05.612227 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.612192    5073 generic.go:356] "Generic (PLEG): container finished" podID="bb48a5f8-05d4-4e81-ac42-54fb322a1184" containerID="5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc" exitCode=0
Oct 30 08:08:05.612413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.612241    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"
Oct 30 08:08:05.612413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.612271    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" event={"ID":"bb48a5f8-05d4-4e81-ac42-54fb322a1184","Type":"ContainerDied","Data":"5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc"}
Oct 30 08:08:05.612413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.612333    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x" event={"ID":"bb48a5f8-05d4-4e81-ac42-54fb322a1184","Type":"ContainerDied","Data":"6392118b061024e824ddb000c911afc01002f4e3767dc1b6bde6d7730a4daf9d"}
Oct 30 08:08:05.612413 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.612364    5073 scope.go:122] "RemoveContainer" containerID="5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc"
Oct 30 08:08:05.622258 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.622236    5073 scope.go:122] "RemoveContainer" containerID="5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc"
Oct 30 08:08:05.622510 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:08:05.622484    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc\": container with ID starting with 5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc not found: ID does not exist" containerID="5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc"
Oct 30 08:08:05.622572 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.622514    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc"} err="failed to get container status \"5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc\": rpc error: code = NotFound desc = could not find container \"5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc\": container with ID starting with 5968ed87027b7f527e85ebb5948c0bbfdb1ea57b2e3c3386900b25cc81d898bc not found: ID does not exist"
Oct 30 08:08:05.674205 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.674174    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"]
Oct 30 08:08:05.685807 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:05.685730    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2eda2c-openshift-default-56cb7f654f-cv28x"]
Oct 30 08:08:06.209049 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:06.209014    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9d797f85-rbbws_391cc1a6-2092-4420-87db-4dca9e49d66a/authorino/0.log"
Oct 30 08:08:07.422673 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:07.422637    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb48a5f8-05d4-4e81-ac42-54fb322a1184" path="/var/lib/kubelet/pods/bb48a5f8-05d4-4e81-ac42-54fb322a1184/volumes"
Oct 30 08:08:13.921635 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:08:13.921592    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:08:16.895770 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:16.895738    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:08:17.119397 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:17.119366    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:08:18.455531 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:18.455497    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:08:18.647605 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:18.647574    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zw8zl_d108dffa-e8c2-449f-bd16-cf71ec233d84/manager/0.log"
Oct 30 08:08:19.865256 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:19.865222    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0ca56cac-h5pqr_0f5ce8a5-bd3d-4e2f-b12e-081eedb7be27/revoke-keys/0.log"
Oct 30 08:08:22.543678 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:22.543647    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-824tj_9404344b-23fc-4236-b354-95b0d8b94e04/postgres/0.log"
Oct 30 08:08:24.062432 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:24.062402    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9d797f85-rbbws_391cc1a6-2092-4420-87db-4dca9e49d66a/authorino/0.log"
Oct 30 08:08:24.298339 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:24.298309    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-rv7dp_caa1fc89-9fb3-4d05-b054-e3654712df59/manager/0.log"
Oct 30 08:08:26.582883 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:26.582836    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-jnpp6_c3a16aa5-0190-4e9c-ab94-415c993ebc77/manager/0.log"
Oct 30 08:08:27.925300 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:27.925267    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln_026c75e2-46b4-47a2-b579-d51e93c9fefe/istio-proxy/0.log"
Oct 30 08:08:28.771291 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:28.771214    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-6v6gx_f0f75d92-2523-4dbe-89d0-628ebd8c8690/istio-proxy/1.log"
Oct 30 08:08:29.603682 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:29.603647    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-xjwvj_898ba0e4-859d-48be-bf3c-d48b71602aeb/istio-proxy/0.log"
Oct 30 08:08:29.799188 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:29.799155    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-58fd47455f-cjkpn_2f5ace0b-c216-4eb9-9343-c4693b1e92c1/istio-proxy/0.log"
Oct 30 08:08:30.008986 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:30.008956    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-fcr4n_b714de5b-3cba-4cd2-ae2d-b371fdde9cf0/payload-pre-processing/0.log"
Oct 30 08:08:30.208682 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:30.208648    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-8r9sh_040eb592-bd9f-4293-9525-703635e87f32/payload-processing/0.log"
Oct 30 08:08:30.420557 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:30.420523    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-789654ff5-xkswj_5d01ad1b-d546-48f6-b5b8-980de74eb623/router/0.log"
Oct 30 08:08:30.903608 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:30.903578    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-6v6gx_f0f75d92-2523-4dbe-89d0-628ebd8c8690/istio-proxy/0.log"
Oct 30 08:08:31.480286 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:31.480254    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-6hq6t_4deb6d10-a8fd-4566-8ef3-4b76d69beadf/main/0.log"
Oct 30 08:08:31.700483 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:31.700454    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-tdzqs_acf27cf6-13c7-4035-b080-77e8afedd8f5/main/0.log"
Oct 30 08:08:31.900155 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:31.900128    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-ddv95_760a53d6-8c6d-4254-b222-c81d7993ac48/main/0.log"
Oct 30 08:08:32.338063 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:32.337993    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8wtckv_45e3ca7d-1f71-4597-b02b-064d4f67a85c/main/0.log"
Oct 30 08:08:32.542821 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:32.542795    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-rvj8l_038e5c00-5b1d-43e5-b566-0783c6e46b8f/main/0.log"
Oct 30 08:08:43.839777 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.839743    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h4tpf/must-gather-hvctt"]
Oct 30 08:08:43.840226 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840211    5073 cpu_manager.go:414] "containerMap: removing container" podUID="bb48a5f8-05d4-4e81-ac42-54fb322a1184" containerName="istio-proxy"
Oct 30 08:08:43.840271 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840228    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb48a5f8-05d4-4e81-ac42-54fb322a1184" containerName="istio-proxy"
Oct 30 08:08:43.840271 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840250    5073 cpu_manager.go:414] "containerMap: removing container" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" containerName="payload-pre-processing"
Oct 30 08:08:43.840271 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840256    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" containerName="payload-pre-processing"
Oct 30 08:08:43.840271 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840269    5073 cpu_manager.go:414] "containerMap: removing container" podUID="ae630470-cbef-4780-9df6-27f416319e22" containerName="payload-processing"
Oct 30 08:08:43.840416 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840274    5073 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae630470-cbef-4780-9df6-27f416319e22" containerName="payload-processing"
Oct 30 08:08:43.840416 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840347    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb48a5f8-05d4-4e81-ac42-54fb322a1184" containerName="istio-proxy"
Oct 30 08:08:43.840416 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840357    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="87421966-6131-48eb-a611-d1ac76a0d19f" containerName="payload-pre-processing"
Oct 30 08:08:43.840416 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.840367    5073 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae630470-cbef-4780-9df6-27f416319e22" containerName="payload-processing"
Oct 30 08:08:43.845170 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.845152    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:43.867148 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.867120    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h4tpf/must-gather-hvctt"]
Oct 30 08:08:43.875162 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.875137    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b88caed9-4379-4ff3-ba32-09d10a6a05d2-must-gather-output\") pod \"must-gather-hvctt\" (UID: \"b88caed9-4379-4ff3-ba32-09d10a6a05d2\") " pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:43.875273 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.875180    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkzp\" (UniqueName: \"kubernetes.io/projected/b88caed9-4379-4ff3-ba32-09d10a6a05d2-kube-api-access-bgkzp\") pod \"must-gather-hvctt\" (UID: \"b88caed9-4379-4ff3-ba32-09d10a6a05d2\") " pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:43.875930 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.875904    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h4tpf\"/\"openshift-service-ca.crt\""
Oct 30 08:08:43.884821 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.884799    5073 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h4tpf\"/\"kube-root-ca.crt\""
Oct 30 08:08:43.885111 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.885096    5073 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h4tpf\"/\"default-dockercfg-x222n\""
Oct 30 08:08:43.922554 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:08:43.922517    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:08:43.976197 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.976162    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b88caed9-4379-4ff3-ba32-09d10a6a05d2-must-gather-output\") pod \"must-gather-hvctt\" (UID: \"b88caed9-4379-4ff3-ba32-09d10a6a05d2\") " pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:43.976353 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.976201    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkzp\" (UniqueName: \"kubernetes.io/projected/b88caed9-4379-4ff3-ba32-09d10a6a05d2-kube-api-access-bgkzp\") pod \"must-gather-hvctt\" (UID: \"b88caed9-4379-4ff3-ba32-09d10a6a05d2\") " pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:43.976508 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:43.976490    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b88caed9-4379-4ff3-ba32-09d10a6a05d2-must-gather-output\") pod \"must-gather-hvctt\" (UID: \"b88caed9-4379-4ff3-ba32-09d10a6a05d2\") " pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:44.032269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:44.032245    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkzp\" (UniqueName: \"kubernetes.io/projected/b88caed9-4379-4ff3-ba32-09d10a6a05d2-kube-api-access-bgkzp\") pod \"must-gather-hvctt\" (UID: \"b88caed9-4379-4ff3-ba32-09d10a6a05d2\") " pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:44.158649 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:44.158620    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h4tpf/must-gather-hvctt"
Oct 30 08:08:44.531243 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:44.531214    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h4tpf/must-gather-hvctt"]
Oct 30 08:08:44.532630 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:08:44.532599    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb88caed9_4379_4ff3_ba32_09d10a6a05d2.slice/crio-2ce6779645792c45d5f29f7af7fd34154a726b7d3013e8d35cb884d0c7a2bf83 WatchSource:0}: Error finding container 2ce6779645792c45d5f29f7af7fd34154a726b7d3013e8d35cb884d0c7a2bf83: Status 404 returned error can't find the container with id 2ce6779645792c45d5f29f7af7fd34154a726b7d3013e8d35cb884d0c7a2bf83
Oct 30 08:08:44.534498 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:44.534480    5073 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 08:08:44.810252 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:44.810174    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4tpf/must-gather-hvctt" event={"ID":"b88caed9-4379-4ff3-ba32-09d10a6a05d2","Type":"ContainerStarted","Data":"2ce6779645792c45d5f29f7af7fd34154a726b7d3013e8d35cb884d0c7a2bf83"}
Oct 30 08:08:45.817725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:45.817636    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4tpf/must-gather-hvctt" event={"ID":"b88caed9-4379-4ff3-ba32-09d10a6a05d2","Type":"ContainerStarted","Data":"eaa9916995c399ace51c72a1e21b2923116fb1703b5990239826ab2f1ec8027a"}
Oct 30 08:08:45.817725 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:45.817678    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4tpf/must-gather-hvctt" event={"ID":"b88caed9-4379-4ff3-ba32-09d10a6a05d2","Type":"ContainerStarted","Data":"bbfc168a48551bcf0ae79b062846897f83f0348497d3961164759aea01d525e7"}
Oct 30 08:08:45.859189 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:45.859136    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-h4tpf/must-gather-hvctt" podStartSLOduration=1.904819646 podStartE2EDuration="2.859121497s" totalImagesPullingTime="954.301851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:08:45.856720572 +0000 UTC m=+4328.564600742" watchObservedRunningTime="2026-10-30 08:08:45.859121497 +0000 UTC m=+4328.567001697"
Oct 30 08:08:48.764330 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:48.764298    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mvld4_a45a4f45-8253-4317-82ca-9edf34f33dbd/global-pull-secret-syncer/0.log"
Oct 30 08:08:49.128261 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:49.128229    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-8ghnm_8d16b2df-cd08-4dd3-a1b3-88274a827068/connection-checker/0.log"
Oct 30 08:08:49.251468 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:49.251431    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-9x2q4_099c00ac-0c53-4bd5-be8f-de38e33f705e/connection-checker/0.log"
Oct 30 08:08:49.376894 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:49.376275    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-rns6c_9e54b74c-ba81-405b-9002-c7ff8719e93d/connection-checker/0.log"
Oct 30 08:08:49.737681 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:49.737636    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-thvhj_b23a23e6-395f-4501-aab1-be26e3ff2236/konnectivity-agent/0.log"
Oct 30 08:08:50.155206 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:50.155169    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-33.ec2.internal_a762c70289af1190dfbc46ead76d62e3/haproxy/0.log"
Oct 30 08:08:51.693321 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:51.693240    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:08:51.761285 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:51.761237    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:08:51.763982 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:51.763887    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:08:51.804786 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:51.804122    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:08:54.270684 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:54.270627    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:08:54.419697 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:54.419670    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:08:57.322009 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:57.321967    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zw8zl_d108dffa-e8c2-449f-bd16-cf71ec233d84/manager/0.log"
Oct 30 08:08:58.558269 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:58.558233    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zw8zl_d108dffa-e8c2-449f-bd16-cf71ec233d84/manager/0.log"
Oct 30 08:08:59.356768 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.356722    5073 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"]
Oct 30 08:08:59.366027 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.365964    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.380774 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.380742    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"]
Oct 30 08:08:59.498724 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.498686    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-lib-modules\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.498928 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.498746    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-podres\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.498928 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.498805    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-sys\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.498928 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.498835    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njhx2\" (UniqueName: \"kubernetes.io/projected/16015d24-f921-4230-85f6-156dc3b20677-kube-api-access-njhx2\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.498928 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.498873    5073 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-proc\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.599513 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599470    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-lib-modules\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599528    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-podres\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599652    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-lib-modules\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599727    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-podres\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599787    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-sys\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599808    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njhx2\" (UniqueName: \"kubernetes.io/projected/16015d24-f921-4230-85f6-156dc3b20677-kube-api-access-njhx2\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599830    5073 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-proc\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599904    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-sys\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.600132 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.599958    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16015d24-f921-4230-85f6-156dc3b20677-proc\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.627418 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.627387    5073 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njhx2\" (UniqueName: \"kubernetes.io/projected/16015d24-f921-4230-85f6-156dc3b20677-kube-api-access-njhx2\") pod \"perf-node-gather-daemonset-cxnxd\" (UID: \"16015d24-f921-4230-85f6-156dc3b20677\") " pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.632996 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.632956    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:08:59.693262 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.693229    5073 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:08:59.852218 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:08:59.852190    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9d797f85-rbbws_391cc1a6-2092-4420-87db-4dca9e49d66a/authorino/0.log"
Oct 30 08:09:00.017187 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.017151    5073 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"]
Oct 30 08:09:00.018266 ip-10-0-132-33 kubenswrapper[5073]: W1030 08:09:00.018233    5073 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16015d24_f921_4230_85f6_156dc3b20677.slice/crio-28c3f00bf1c64f072098db554bf611f77e2b9ad496c09297ef5624f7e0d58d60 WatchSource:0}: Error finding container 28c3f00bf1c64f072098db554bf611f77e2b9ad496c09297ef5624f7e0d58d60: Status 404 returned error can't find the container with id 28c3f00bf1c64f072098db554bf611f77e2b9ad496c09297ef5624f7e0d58d60
Oct 30 08:09:00.046408 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.046384    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:09:00.261186 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.261152    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-rv7dp_caa1fc89-9fb3-4d05-b054-e3654712df59/manager/0.log"
Oct 30 08:09:00.967515 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.967482    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:09:00.982742 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.982700    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd" event={"ID":"16015d24-f921-4230-85f6-156dc3b20677","Type":"ContainerStarted","Data":"943adf0c67e7b594b2781116dd3423e1edade7e58282ff0ecfc827748127a355"}
Oct 30 08:09:00.982942 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.982775    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd" event={"ID":"16015d24-f921-4230-85f6-156dc3b20677","Type":"ContainerStarted","Data":"28c3f00bf1c64f072098db554bf611f77e2b9ad496c09297ef5624f7e0d58d60"}
Oct 30 08:09:00.982942 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:00.982890    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:09:01.022793 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:01.022739    5073 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd" podStartSLOduration=2.022725482 podStartE2EDuration="2.022725482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:09:01.022071468 +0000 UTC m=+4343.729951639" watchObservedRunningTime="2026-10-30 08:09:01.022725482 +0000 UTC m=+4343.730605650"
Oct 30 08:09:01.972938 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:01.972907    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:09:04.126505 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:04.126459    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"]
Oct 30 08:09:04.127018 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:04.126745    5073 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerName="istio-proxy" containerID="cri-o://e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2" gracePeriod=30
Oct 30 08:09:04.741204 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:04.741161    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:09:06.680803 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:06.680767    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-jnpp6_c3a16aa5-0190-4e9c-ab94-415c993ebc77/manager/0.log"
Oct 30 08:09:06.982323 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:06.982244    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:09:07.001447 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:07.001417    5073 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h4tpf/perf-node-gather-daemonset-cxnxd"
Oct 30 08:09:09.416936 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.416835    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 08:09:09.507052 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507018    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507260 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507090    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507260 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507153    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507260 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507192    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507260 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507231    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507314    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507365    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507400    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507397    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:09:09.507517 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507427    5073 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket\") pod \"898ba0e4-859d-48be-bf3c-d48b71602aeb\" (UID: \"898ba0e4-859d-48be-bf3c-d48b71602aeb\") "
Oct 30 08:09:09.507895 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507844    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:09:09.507973 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507913    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:09:09.508047 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.508024    5073 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-data\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.508497 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.507616    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 08:09:09.508801 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.508770    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:09:09.509750 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.509726    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 08:09:09.510338 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.510314    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "kube-api-access-xkhdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:09:09.510581 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.510552    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 08:09:09.510918 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.510900    5073 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo" pod "898ba0e4-859d-48be-bf3c-d48b71602aeb" (UID: "898ba0e4-859d-48be-bf3c-d48b71602aeb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 08:09:09.609024 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.608996    5073 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-credential-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609024 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609022    5073 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-podinfo\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609032    5073 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-token\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609045    5073 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkhdp\" (UniqueName: \"kubernetes.io/projected/898ba0e4-859d-48be-bf3c-d48b71602aeb-kube-api-access-xkhdp\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609055    5073 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-certs\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609063    5073 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-workload-socket\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609071    5073 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/898ba0e4-859d-48be-bf3c-d48b71602aeb-istio-envoy\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.609221 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.609079    5073 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/898ba0e4-859d-48be-bf3c-d48b71602aeb-istiod-ca-cert\") on node \"ip-10-0-132-33.ec2.internal\" DevicePath \"\""
Oct 30 08:09:09.612224 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:09.612202    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zw8zl_d108dffa-e8c2-449f-bd16-cf71ec233d84/manager/0.log"
Oct 30 08:09:10.046409 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.046365    5073 generic.go:356] "Generic (PLEG): container finished" podID="898ba0e4-859d-48be-bf3c-d48b71602aeb" containerID="e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2" exitCode=0
Oct 30 08:09:10.046637 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.046457    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" event={"ID":"898ba0e4-859d-48be-bf3c-d48b71602aeb","Type":"ContainerDied","Data":"e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2"}
Oct 30 08:09:10.046637 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.046524    5073 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj" event={"ID":"898ba0e4-859d-48be-bf3c-d48b71602aeb","Type":"ContainerDied","Data":"9bb8e800d442b77af40b05ec96616504857e92af2c93bc631657a0d70dffba74"}
Oct 30 08:09:10.046637 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.046558    5073 scope.go:122] "RemoveContainer" containerID="e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2"
Oct 30 08:09:10.046829 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.046737    5073 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"
Oct 30 08:09:10.060046 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.060022    5073 scope.go:122] "RemoveContainer" containerID="e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2"
Oct 30 08:09:10.060424 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:09:10.060399    5073 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2\": container with ID starting with e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2 not found: ID does not exist" containerID="e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2"
Oct 30 08:09:10.060525 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.060432    5073 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2"} err="failed to get container status \"e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2\": rpc error: code = NotFound desc = could not find container \"e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2\": container with ID starting with e89b15f630a08c9e550bf7030f18d5e6624db7ed4123c80bca964e75e798cec2 not found: ID does not exist"
Oct 30 08:09:10.099374 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.099322    5073 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"]
Oct 30 08:09:10.110602 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:10.110571    5073 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xjwvj"]
Oct 30 08:09:11.109544 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:11.109507    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zw8zl_d108dffa-e8c2-449f-bd16-cf71ec233d84/manager/0.log"
Oct 30 08:09:11.427497 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:11.427369    5073 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="898ba0e4-859d-48be-bf3c-d48b71602aeb" path="/var/lib/kubelet/pods/898ba0e4-859d-48be-bf3c-d48b71602aeb/volumes"
Oct 30 08:09:11.944447 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:11.944412    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-88z7x_df38da75-f716-4dd4-a6eb-f736d0d2ac6c/cluster-monitoring-operator/0.log"
Oct 30 08:09:12.005325 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:12.005298    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:09:12.058076 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:12.058040    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:09:13.233444 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:13.233412    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d699c9f7cjnqln_026c75e2-46b4-47a2-b579-d51e93c9fefe/istio-proxy/0.log"
Oct 30 08:09:13.417428 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:13.417398    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-55c8cc7799-jxvjj_c6c0df3a-03bb-4854-8648-d00495b75313/manager/0.log"
Oct 30 08:09:13.424570 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:13.424546    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8dl2_32602ee3-cc2f-4e73-9eb5-5481a6022fbc/node-exporter/0.log"
Oct 30 08:09:13.595474 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:13.595399    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-f8dq9_e82aa31d-bbaf-46d6-8a5c-c8a89db856e5/manager/0.log"
Oct 30 08:09:13.926401 ip-10-0-132-33 kubenswrapper[5073]: E1030 08:09:13.926365    5073 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-w9vw6" containerName="extractor"
Oct 30 08:09:14.140883 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:14.140829    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8dl2_32602ee3-cc2f-4e73-9eb5-5481a6022fbc/kube-rbac-proxy/0.log"
Oct 30 08:09:14.911923 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:14.911889    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-bvqnf_ae0aa6ff-7aed-4a46-ae38-2c6618821fec/server/0.log"
Oct 30 08:09:14.921192 ip-10-0-132-33 kubenswrapper[5073]: I1030 08:09:14.921158    5073 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8dl2_32602ee3-cc2f-4e73-9eb5-5481a6022fbc/init-textfile/0.log"