Jul 20 13:36:31.427918 ip-10-0-131-139 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 13:36:31.427930 ip-10-0-131-139 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 13:36:31.427940 ip-10-0-131-139 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 13:36:31.428258 ip-10-0-131-139 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 13:36:42.930013 ip-10-0-131-139 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 13:36:42.930032 ip-10-0-131-139 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 159d483bd4d14c5f8f9f368c36ade457 --
Jul 20 13:38:14.589503 ip-10-0-131-139 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 13:38:15.032147 ip-10-0-131-139 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:38:15.032147 ip-10-0-131-139 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 13:38:15.032147 ip-10-0-131-139 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:38:15.032147 ip-10-0-131-139 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 13:38:15.032147 ip-10-0-131-139 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:38:15.034380 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.034230    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 13:38:15.039699 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039668    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:15.039699 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039693    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:15.039699 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039699    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:15.039699 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039703    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:15.039699 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039707    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:15.039699 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039711    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039715    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039719    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039725    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039730    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039734    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039737    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039741    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039744    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039747    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039751    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039755    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039758    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039762    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039766    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039769    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039774    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039777    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039781    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039793    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:15.040082 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039798    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039802    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039805    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039809    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039813    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039816    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039820    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039824    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039827    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039832    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039835    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039839    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039843    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039846    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039851    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039855    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039859    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039863    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039868    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039871    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:15.040960 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039876    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039883    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039889    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039893    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039898    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039911    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039915    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039920    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039924    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039928    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039932    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039946    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039952    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039956    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039960    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039964    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039968    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039989    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039993    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:15.041827 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.039999    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040003    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040007    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040011    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040016    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040020    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040026    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040032    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040038    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040044    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040049    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040054    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040059    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040065    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040070    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040075    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040078    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040082    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040086    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:15.042593 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040098    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040103    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040107    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040111    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040115    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040127    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040132    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040136    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040141    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040144    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040149    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040153    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040176    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040180    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040185    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.040189    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041463    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041474    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041479    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041483    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:15.043402 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041490    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041495    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041499    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041503    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041507    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041511    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041515    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041519    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041524    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041528    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041532    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041536    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041540    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041552    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041557    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041562    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041566    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041570    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041574    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041578    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:15.044285 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041582    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041586    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041590    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041594    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041600    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041604    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041608    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041612    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041617    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041621    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041625    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041628    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041634    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041638    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041642    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041646    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041653    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041659    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041664    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:15.045031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041668    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041672    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041677    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041681    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041685    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041689    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041693    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041705    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041709    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041713    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041717    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041721    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041726    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041730    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041734    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041738    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041741    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041745    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041749    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041753    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:15.045523 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041757    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041762    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041766    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041770    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041773    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041779    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041783    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041787    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041791    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041795    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041799    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041803    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041807    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041811    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041815    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041823    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041828    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041833    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041836    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:15.046195 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041840    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041852    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041861    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041866    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041870    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041874    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041879    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041883    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041887    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041891    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041894    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041898    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041902    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041907    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041911    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041915    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.041919    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042658    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042669    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:15.046810 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042674    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042679    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042683    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042688    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042692    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042696    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042700    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042706    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042712    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042717    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042722    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042726    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042731    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042735    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042741    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042745    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042749    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042753    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042759    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042763    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:15.047421 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042768    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042772    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042776    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042780    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042785    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042792    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042798    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042802    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042807    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042811    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042815    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042820    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042825    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042829    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042833    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042844    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042848    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042852    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042856    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:15.047896 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042860    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042864    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042868    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042872    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042876    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042880    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042885    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042889    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042893    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042898    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042901    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042905    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042910    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042913    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042918    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042921    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042926    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042930    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042934    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042938    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:15.048508 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042943    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042949    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042953    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042958    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042962    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042966    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042970    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042976    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042982    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042986    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042990    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042994    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.042998    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043002    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043006    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043010    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043014    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043018    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043022    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043026    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:15.049000 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043030    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043035    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043039    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043044    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043048    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043052    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043055    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043060    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043069    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043074    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043078    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043082    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043086    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043091    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043094    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043098    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043102    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.043107    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043242    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043255    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043264    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 13:38:15.049514 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043271    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043277    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043282    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043288    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043295    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043300    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043305    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043311    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043316    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043321    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043325    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043330    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043334    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043341    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043345    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043352    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043356    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043360    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043365    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043376    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043382    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043387    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043392    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 13:38:15.049994 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043397    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043401    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043405    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043409    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043414    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043418    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043430    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043435    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043439    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043444    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043449    2559 flags.go:64] FLAG: --enable-server="true"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043453    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043459    2559 flags.go:64] FLAG: --event-burst="100"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043464    2559 flags.go:64] FLAG: --event-qps="50"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043468    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043473    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043477    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043483    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043488    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043492    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043497    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043501    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043506    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043511    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043516    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 13:38:15.050543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043521    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043526    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043530    2559 flags.go:64] FLAG: --feature-gates=""
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043539    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043543    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043548    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043553    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043558    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043562    2559 flags.go:64] FLAG: --help="false"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043567    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043572    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043578    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043583    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043588    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043593    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043598    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043603    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043607    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043612    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043616    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043621    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043625    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043629    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043633    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 13:38:15.051234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043638    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043643    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043647    2559 flags.go:64] FLAG: --lock-file=""
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043652    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043657    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043662    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043670    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043675    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043679    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043684    2559 flags.go:64] FLAG: --logging-format="text"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043688    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043697    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043701    2559 flags.go:64] FLAG: --manifest-url=""
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043706    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043712    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043717    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043723    2559 flags.go:64] FLAG: --max-pods="110"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043728    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043733    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043737    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043742    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043747    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043751    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043755    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043767    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 13:38:15.051892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043772    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043777    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043781    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043786    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043794    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043798    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043803    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043807    2559 flags.go:64] FLAG: --port="10250"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043812    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043816    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c01fa58ccd88820b"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043821    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043826    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043830    2559 flags.go:64] FLAG: --register-node="true"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043835    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043840    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043846    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043850    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043855    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043863    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043870    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043874    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043879    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043883    2559 flags.go:64] FLAG: --runonce="false"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043888    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043893    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 13:38:15.052557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043897    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043902    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043906    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043910    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043915    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043920    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043924    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043929    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043933    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043945    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043950    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043955    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043959    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043968    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043989    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.043994    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044001    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044006    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044010    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044014    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044019    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044024    2559 flags.go:64] FLAG: --v="2"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044030    2559 flags.go:64] FLAG: --version="false"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044046    2559 flags.go:64] FLAG: --vmodule=""
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044058    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 13:38:15.053185 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.044065    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044272    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044280    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044284    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044289    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044293    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044299    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044303    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044307    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044312    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044316    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044321    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044325    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044331    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044335    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044340    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044344    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044349    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044353    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:15.053785 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044361    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044366    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044372    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044376    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044380    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044384    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044389    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044393    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044397    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044400    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044405    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044409    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044414    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044421    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044426    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044430    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044434    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044438    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044442    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044447    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:15.054293 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044451    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044455    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044459    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044465    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044470    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044476    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044480    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044484    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044489    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044493    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044497    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044501    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044505    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044510    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044514    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044518    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044522    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044526    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044530    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044534    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:15.054769 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044538    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044542    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044546    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044550    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044554    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044560    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044566    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044570    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044574    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044578    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044582    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044587    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044591    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044595    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044599    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044603    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044607    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044611    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044615    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:15.055259 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044620    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044624    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044628    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044635    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044640    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044645    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044649    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044653    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044657    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044662    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044666    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044670    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044674    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044678    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044684    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044688    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044692    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044697    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044705    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044714    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:15.055705 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044719    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.044722    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.045751    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.053231    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.053247    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.053267    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.053277    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053358    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053366    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053372    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053375    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053379    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053384    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053387    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:15.056234 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053392    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053396    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053399    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053403    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053406    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053410    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053414    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053418    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053422    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053426    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053430    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053433    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053435    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053438    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053440    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053443    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053446    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053450    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053453    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053455    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:15.056591 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053458    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053460    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053464    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053467    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053469    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053472    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053475    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053477    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053480    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053483    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053485    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053488    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053492    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053495    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053498    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053501    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053504    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053506    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053509    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053511    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:15.057106 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053514    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053516    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053519    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053521    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053523    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053526    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053528    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053531    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053533    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053536    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053539    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053541    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053544    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053546    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053550    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053552    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053555    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053558    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053561    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:15.057619 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053563    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053566    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053570    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053573    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053575    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053578    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053580    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053583    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053585    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053588    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053591    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053593    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053595    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053598    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053600    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053602    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053605    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053607    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053609    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:15.058103 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053612    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053614    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053617    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053619    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053622    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053625    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053628    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053631    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053634    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053637    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053640    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053644    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053646    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053649    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:15.058589 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.053655    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053772    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053777    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053780    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053783    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053785    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053789    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053793    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053796    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053799    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053802    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053805    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053807    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053810    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053812    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053814    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053817    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053819    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053821    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:38:15.058924 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053824    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053826    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053828    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053831    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053833    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053837    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053839    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053842    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053844    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053847    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053849    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053852    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053854    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053857    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053859    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053861    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053864    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053866    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053868    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053871    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:38:15.059462 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053873    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053875    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053877    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053880    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053882    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053884    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053887    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053889    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053891    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053894    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053896    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053899    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053901    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053904    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053906    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053909    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053911    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053914    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053922    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:38:15.059931 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053925    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053928    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053931    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053933    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053935    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053937    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053940    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053942    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053944    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053947    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053949    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053951    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053954    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053956    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053958    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053961    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053963    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053966    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053968    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053970    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:38:15.060438 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053973    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053975    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053978    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053980    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053982    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053985    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053987    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053990    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053993    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053995    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.053998    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054000    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054004    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054008    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054011    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054013    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054016    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054019    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054021    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:38:15.060946 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054023    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054026    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:15.054028    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.054033    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.054146    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.056769    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.058377    2559 server.go:1019] "Starting client certificate rotation"
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.058482    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.058512    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:38:15.061439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.060617    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:38:15.065998 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.065973    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:38:15.072286 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.072267    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 20 13:38:15.074496 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.074478    2559 log.go:25] "Validated CRI v1 image API"
Jul 20 13:38:15.075345 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.075328    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 13:38:15.080668 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.080642    2559 fs.go:135] Filesystem UUIDs: map[610d40e4-62e0-434d-abed-cfd7e4569484:/dev/nvme0n1p3 785c8633-4749-4d9d-9252-71d964ce7de6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 20 13:38:15.080759 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.080666    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 13:38:15.085792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.085672    2559 manager.go:216] Machine: {Timestamp:2026-07-20 13:38:15.084367439 +0000 UTC m=+0.359611959 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104960 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec268f5e7af1965c61c699ea3e8cf2bc SystemUUID:ec268f5e-7af1-965c-61c6-99ea3e8cf2bc BootID:159d483b-d4d1-4c5f-8f9f-368c36ade457 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:fd:53:73:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:fd:53:73:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:0d:68:a1:51:de Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 13:38:15.085792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.085781    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 13:38:15.085977 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.085890    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 13:38:15.088776 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.088751    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 13:38:15.088943 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.088778    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 13:38:15.089224 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.089198    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:38:15.089535 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.089523    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 13:38:15.089568 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.089539    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 13:38:15.089568 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.089547    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:38:15.089621 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.089581    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:38:15.090922 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.090912    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 13:38:15.094265 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094254    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:38:15.094386 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094377    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 13:38:15.094434 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094425    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 13:38:15.094463 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094442    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 13:38:15.094463 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094460    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 13:38:15.094543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094473    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 20 13:38:15.094543 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094487    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 13:38:15.094846 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094835    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:38:15.094879 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.094854    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:38:15.097763 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.097737    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 13:38:15.099958 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.099945    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 13:38:15.100031 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.099993    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 13:38:15.101031 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101019    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 13:38:15.101073 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101036    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 13:38:15.101073 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101045    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 13:38:15.101073 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101053    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 13:38:15.101073 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101068    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101076    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101088    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101107    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101117    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101124    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101136    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 13:38:15.101209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.101149    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 13:38:15.102432 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.102408    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 13:38:15.102600 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.102588    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 13:38:15.106585 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.106559    2559 server.go:1268] "Started kubelet"
Jul 20 13:38:15.106748 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.106721    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 13:38:15.106851 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.106805    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 13:38:15.106905 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.106875    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 13:38:15.107414 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.107393    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 13:38:15.107517 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.107493    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 13:38:15.107501 ip-10-0-131-139 systemd[1]: Started Kubernetes Kubelet.
Jul 20 13:38:15.107821 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.107644    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 13:38:15.108881 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.108862    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 13:38:15.109405 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.109392    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 13:38:15.111816 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.111797    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 13:38:15.116923 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.116905    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 13:38:15.117022 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.116905    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 13:38:15.117072 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.117020    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.117655 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117576    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 13:38:15.117655 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117577    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 13:38:15.117655 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117602    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 13:38:15.117813 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117685    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 13:38:15.117813 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117692    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 13:38:15.118115 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117850    2559 factory.go:55] Registering systemd factory
Jul 20 13:38:15.118115 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.117866    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 20 13:38:15.118115 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.118104    2559 factory.go:153] Registering CRI-O factory
Jul 20 13:38:15.118261 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.118120    2559 factory.go:223] Registration of the crio container factory successfully
Jul 20 13:38:15.118261 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.118194    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 13:38:15.118261 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.118220    2559 factory.go:103] Registering Raw factory
Jul 20 13:38:15.118261 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.118238    2559 manager.go:1196] Started watching for new ooms in manager
Jul 20 13:38:15.118550 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.118537    2559 manager.go:349] Starting recovery of all containers
Jul 20 13:38:15.119829 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.119790    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 13:38:15.119931 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.118870    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-139.ec2.internal.18c4030a4c14874d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-139.ec2.internal,UID:ip-10-0-131-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-139.ec2.internal,},FirstTimestamp:2026-07-20 13:38:15.106529101 +0000 UTC m=+0.381773620,LastTimestamp:2026-07-20 13:38:15.106529101 +0000 UTC m=+0.381773620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-139.ec2.internal,}"
Jul 20 13:38:15.120029 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.119927    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 13:38:15.129410 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.129388    2559 manager.go:354] Recovery completed
Jul 20 13:38:15.134048 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.134033    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.135820 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.135804    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.135900 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.135832    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.135900 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.135842    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.136455 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.136433    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 13:38:15.136455 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.136448    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 13:38:15.136537 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.136469    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:38:15.136537 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.136512    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.137203 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.137183    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.137274 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.137217    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.137274 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.137231    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.137836 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.137825    2559 policy_none.go:49] "None policy: Start"
Jul 20 13:38:15.137870 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.137841    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 13:38:15.137870 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.137852    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 13:38:15.138830 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.138820    2559 policy_none.go:47] "Start"
Jul 20 13:38:15.140034 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.140018    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bq72l"
Jul 20 13:38:15.145938 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.145920    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bq72l"
Jul 20 13:38:15.146678 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.146612    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-139.ec2.internal.18c4030a4dd37889  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-139.ec2.internal,UID:ip-10-0-131-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-139.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-139.ec2.internal,},FirstTimestamp:2026-07-20 13:38:15.135819913 +0000 UTC m=+0.411064435,LastTimestamp:2026-07-20 13:38:15.135819913 +0000 UTC m=+0.411064435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-139.ec2.internal,}"
Jul 20 13:38:15.172996 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.172803    2559 manager.go:337] "Starting Device Plugin manager"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.173023    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.173039    2559 server.go:87] "Starting device plugin registration server"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.173336    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.173347    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.173447    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.173535    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.173553    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.174014    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.174060    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.184775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.184705    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 13:38:15.186005 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.185989    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 13:38:15.186060 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.186027    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 13:38:15.186060 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.186050    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 13:38:15.186137 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.186082    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 13:38:15.188544 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.188523    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:15.273876 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.273843    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.274840 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.274822    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.274912 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.274855    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.274912 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.274865    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.274912 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.274887    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.285819 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.285768    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.285819 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.285793    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-139.ec2.internal\": node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.287438 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.287417    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"]
Jul 20 13:38:15.287497 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.287486    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.288415 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.288399    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.288506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.288428    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.288506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.288438    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.289746 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.289732    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.289881 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.289869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.289924 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.289899    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.290459 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.290446    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.290530 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.290459    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.290530 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.290470    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.290530 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.290479    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.290530 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.290480    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.290530 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.290489    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.291636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.291623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.291759 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.291647    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:15.292375 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.292359    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:15.292453 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.292392    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:15.292453 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.292406    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:15.318851 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.318825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1890c873ddae72ffbd5b00871ebc86f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal\" (UID: \"1890c873ddae72ffbd5b00871ebc86f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.318938 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.318889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c5424a690786bcc920675f485fb0103-config\") pod \"kube-apiserver-proxy-ip-10-0-131-139.ec2.internal\" (UID: \"1c5424a690786bcc920675f485fb0103\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.318938 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.318910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1890c873ddae72ffbd5b00871ebc86f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal\" (UID: \"1890c873ddae72ffbd5b00871ebc86f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.318938 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.318914    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-139.ec2.internal\" not found" node="ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.323310 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.323296    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-139.ec2.internal\" not found" node="ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.326027 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.326012    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.419774 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.419739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1890c873ddae72ffbd5b00871ebc86f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal\" (UID: \"1890c873ddae72ffbd5b00871ebc86f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.419774 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.419776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1890c873ddae72ffbd5b00871ebc86f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal\" (UID: \"1890c873ddae72ffbd5b00871ebc86f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.420011 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.419801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c5424a690786bcc920675f485fb0103-config\") pod \"kube-apiserver-proxy-ip-10-0-131-139.ec2.internal\" (UID: \"1c5424a690786bcc920675f485fb0103\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.420011 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.419831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c5424a690786bcc920675f485fb0103-config\") pod \"kube-apiserver-proxy-ip-10-0-131-139.ec2.internal\" (UID: \"1c5424a690786bcc920675f485fb0103\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.420011 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.419833    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1890c873ddae72ffbd5b00871ebc86f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal\" (UID: \"1890c873ddae72ffbd5b00871ebc86f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.420011 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.419837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1890c873ddae72ffbd5b00871ebc86f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal\" (UID: \"1890c873ddae72ffbd5b00871ebc86f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.426666 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.426641    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.527447 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.527401    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.622201 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.622137    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.626957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:15.626941    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:15.628035 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.628017    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.728192 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.728110    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.828758 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.828708    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:15.929373 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:15.929295    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.029971 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:16.029931    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.058128 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.058093    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 13:38:16.058569 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.058263    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:38:16.096383 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.096358    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:16.102363 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.102337    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:16.130913 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:16.130876    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.150134 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.150052    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 13:33:15 +0000 UTC" deadline="2028-04-30 19:27:14.701564236 +0000 UTC"
Jul 20 13:38:16.150134 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.150092    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15605h48m58.55147689s"
Jul 20 13:38:16.209322 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:16.209284    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1890c873ddae72ffbd5b00871ebc86f2.slice/crio-b994467e813e1c29d20e33f5412ff29f0e3405c9711093ae40a8aa86d10c0984 WatchSource:0}: Error finding container b994467e813e1c29d20e33f5412ff29f0e3405c9711093ae40a8aa86d10c0984: Status 404 returned error can't find the container with id b994467e813e1c29d20e33f5412ff29f0e3405c9711093ae40a8aa86d10c0984
Jul 20 13:38:16.210251 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:16.210219    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5424a690786bcc920675f485fb0103.slice/crio-c41d858af60935c5916e0bbb59f33d8f225b4d50019d041ecd2f64fdcff55534 WatchSource:0}: Error finding container c41d858af60935c5916e0bbb59f33d8f225b4d50019d041ecd2f64fdcff55534: Status 404 returned error can't find the container with id c41d858af60935c5916e0bbb59f33d8f225b4d50019d041ecd2f64fdcff55534
Jul 20 13:38:16.215655 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.215633    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:38:16.231451 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:16.231429    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.261630 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.261580    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:38:16.262916 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.262893    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:38:16.263003 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.262926    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:38:16.263003 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.262941    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:38:16.331768 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:16.331733    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.432244 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:16.432216    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.532843 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:16.532772    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-139.ec2.internal\" not found"
Jul 20 13:38:16.567506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.567482    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:16.618613 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.618571    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:16.633224 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.633192    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:38:16.634441 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.634423    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal"
Jul 20 13:38:16.647510 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:16.647484    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:38:17.095598 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.095565    2559 apiserver.go:52] "Watching apiserver"
Jul 20 13:38:17.103430 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.103402    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 13:38:17.104818 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.104785    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-h5q5q","openshift-network-diagnostics/network-check-target-7j7rl","kube-system/konnectivity-agent-tqh88","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55","openshift-dns/node-resolver-tgj6m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal","openshift-network-operator/iptables-alerter-gznm5","openshift-ovn-kubernetes/ovnkube-node-xv9hj","kube-system/global-pull-secret-syncer-5ppt7","kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2rwct","openshift-image-registry/node-ca-rx6gq","openshift-multus/multus-additional-cni-plugins-s8v5d","openshift-multus/multus-sc2mt"]
Jul 20 13:38:17.106362 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.106341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.108386 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.108366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.109496 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.109446    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9dc9j\""
Jul 20 13:38:17.109654 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.109630    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.109727 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.109653    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.109848 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.109830    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 13:38:17.110460 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.110440    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.110916 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.110898    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 13:38:17.111081 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.111067    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9jflk\""
Jul 20 13:38:17.111396 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.111381    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 13:38:17.111524 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.111509    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.111661 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.111647    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 13:38:17.111956 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.111941    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.112408 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.112384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.113643 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.113623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.114932 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.114912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.116134 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.116101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.116269 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.116194    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:17.118814 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.118122    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 13:38:17.118814 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.118356    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.118814 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.118417    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:17.119080 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.118976    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 13:38:17.119396 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.119315    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:17.119396 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.119364    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:17.119918 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.119899    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jts29\""
Jul 20 13:38:17.120139 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.120124    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xz6hs\""
Jul 20 13:38:17.120398 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.120383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 13:38:17.126257 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.125387    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ks2rz\""
Jul 20 13:38:17.126257 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.126162    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.126415 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.126314    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.126604 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.126521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.127260 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.127074    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xgpzr\""
Jul 20 13:38:17.127260 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.127079    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 13:38:17.127414 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.127135    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.127414 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.127191    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.127846 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.127668    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128835    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128864    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-socket-dir-parent\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-kubelet\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128980    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.128993    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-socket-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-cnibin\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-os-release\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a431a02-a3be-4869-9b22-5a62f3308d91-tmp-dir\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-cni-bin\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-hostroot\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-etc-kubernetes\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.129255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-registration-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0176da58-049e-421f-8ec0-0eabc63e7228-host-slash\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd8dx\" (UniqueName: \"kubernetes.io/projected/0176da58-049e-421f-8ec0-0eabc63e7228-kube-api-access-hd8dx\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-system-cni-dir\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129396    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sfrj2\""
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129432    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-sys-fs\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jztv\" (UniqueName: \"kubernetes.io/projected/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-kube-api-access-5jztv\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-cni-binary-copy\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-k8s-cni-cncf-io\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-conf-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zzb5\" (UniqueName: \"kubernetes.io/projected/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-kube-api-access-7zzb5\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c9a2392-d69a-4447-baf5-cbab4c308510-agent-certs\") pod \"konnectivity-agent-tqh88\" (UID: \"6c9a2392-d69a-4447-baf5-cbab4c308510\") " pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-device-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.130045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-system-cni-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-os-release\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-netns\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xntmd\" (UniqueName: \"kubernetes.io/projected/ee604215-f88c-489c-9285-c937f297c47d-kube-api-access-xntmd\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a431a02-a3be-4869-9b22-5a62f3308d91-hosts-file\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrpp4\" (UniqueName: \"kubernetes.io/projected/7a431a02-a3be-4869-9b22-5a62f3308d91-kube-api-access-nrpp4\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-cni-multus\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.129985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0176da58-049e-421f-8ec0-0eabc63e7228-iptables-alerter-script\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-cni-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-cnibin\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-daemon-config\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-multus-certs\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c9a2392-d69a-4447-baf5-cbab4c308510-konnectivity-ca\") pod \"konnectivity-agent-tqh88\" (UID: \"6c9a2392-d69a-4447-baf5-cbab4c308510\") " pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.130781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-kubelet-config\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.131458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-dbus\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.131458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.131458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbdb\" (UniqueName: \"kubernetes.io/projected/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-kube-api-access-hkbdb\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.131458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130657    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 13:38:17.131458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.130681    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 13:38:17.131458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.131058    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.132067 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.132046    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.132327 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.132306    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q8w8p\""
Jul 20 13:38:17.132407 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.132311    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 13:38:17.133366 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.133171    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 13:38:17.133366 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.133224    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 13:38:17.133366 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.133261    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9j9p5\""
Jul 20 13:38:17.135548 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.135527    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:38:17.147158 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.147134    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:38:17.162913 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.162888    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hm9mc"
Jul 20 13:38:17.171105 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.171080    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hm9mc"
Jul 20 13:38:17.192106 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.192053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal" event={"ID":"1c5424a690786bcc920675f485fb0103","Type":"ContainerStarted","Data":"c41d858af60935c5916e0bbb59f33d8f225b4d50019d041ecd2f64fdcff55534"}
Jul 20 13:38:17.193913 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.193891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal" event={"ID":"1890c873ddae72ffbd5b00871ebc86f2","Type":"ContainerStarted","Data":"b994467e813e1c29d20e33f5412ff29f0e3405c9711093ae40a8aa86d10c0984"}
Jul 20 13:38:17.219097 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.219015    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 13:38:17.230784 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-hostroot\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.230916 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-etc-kubernetes\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.230916 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0176da58-049e-421f-8ec0-0eabc63e7228-host-slash\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.230916 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8dx\" (UniqueName: \"kubernetes.io/projected/0176da58-049e-421f-8ec0-0eabc63e7228-kube-api-access-hd8dx\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.230916 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230874    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-hostroot\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-etc-kubernetes\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-system-cni-dir\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230880    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-system-cni-dir\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jztv\" (UniqueName: \"kubernetes.io/projected/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-kube-api-access-5jztv\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysctl-d\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-sys\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-systemd\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-var-lib-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-cni-bin\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkfhw\" (UniqueName: \"kubernetes.io/projected/c20c5d6b-f67d-4bd2-a286-9570402675df-kube-api-access-wkfhw\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-cni-binary-copy\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-k8s-cni-cncf-io\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-device-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.231221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-env-overrides\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-system-cni-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-netns\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xntmd\" (UniqueName: \"kubernetes.io/projected/ee604215-f88c-489c-9285-c937f297c47d-kube-api-access-xntmd\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-var-lib-kubelet\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.230969    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0176da58-049e-421f-8ec0-0eabc63e7228-host-slash\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-host\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-k8s-cni-cncf-io\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-system-cni-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.231946 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.231575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-device-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-cni-binary-copy\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-netns\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5065019-e701-4274-8316-988546bdeffa-host\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-cni-multus\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4696b71f-8d64-4d28-b974-e05e77d7ed19-tmp\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-cni-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-daemon-config\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-multus-certs\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-cni-multus\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.232506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4q4\" (UniqueName: \"kubernetes.io/projected/a5065019-e701-4274-8316-988546bdeffa-kube-api-access-bh4q4\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-dbus\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-run-multus-certs\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-run\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-kubernetes\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-cni-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-socket-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-cnibin\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a431a02-a3be-4869-9b22-5a62f3308d91-tmp-dir\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-kubelet\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.232993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-ovn\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-run-ovn-kubernetes\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-systemd\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-daemon-config\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-cni-bin\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.233101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-registration-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-dbus\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-tuned\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233185    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-registration-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qk8\" (UniqueName: \"kubernetes.io/projected/4696b71f-8d64-4d28-b974-e05e77d7ed19-kube-api-access-59qk8\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-run-netns\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-ovnkube-config\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5065019-e701-4274-8316-988546bdeffa-serviceca\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-socket-dir\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-cnibin\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-sys-fs\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysconfig\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233449    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-node-log\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-conf-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zzb5\" (UniqueName: \"kubernetes.io/projected/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-kube-api-access-7zzb5\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.234087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c9a2392-d69a-4447-baf5-cbab4c308510-agent-certs\") pod \"konnectivity-agent-tqh88\" (UID: \"6c9a2392-d69a-4447-baf5-cbab4c308510\") " pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-cni-netd\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-os-release\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a431a02-a3be-4869-9b22-5a62f3308d91-hosts-file\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrpp4\" (UniqueName: \"kubernetes.io/projected/7a431a02-a3be-4869-9b22-5a62f3308d91-kube-api-access-nrpp4\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c20c5d6b-f67d-4bd2-a286-9570402675df-ovn-node-metrics-cert\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0176da58-049e-421f-8ec0-0eabc63e7228-iptables-alerter-script\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233821    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-lib-modules\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-slash\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-etc-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-cnibin\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c9a2392-d69a-4447-baf5-cbab4c308510-konnectivity-ca\") pod \"konnectivity-agent-tqh88\" (UID: \"6c9a2392-d69a-4447-baf5-cbab4c308510\") " pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.233976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-systemd-units\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234115    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 13:38:17.234968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-log-socket\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234172    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-ovnkube-script-lib\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-kubelet-config\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbdb\" (UniqueName: \"kubernetes.io/projected/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-kube-api-access-hkbdb\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-socket-dir-parent\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-kubelet\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-os-release\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-modprobe-d\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysctl-conf\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234618    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-cnibin\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.234955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0176da58-049e-421f-8ec0-0eabc63e7228-iptables-alerter-script\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c9a2392-d69a-4447-baf5-cbab4c308510-konnectivity-ca\") pod \"konnectivity-agent-tqh88\" (UID: \"6c9a2392-d69a-4447-baf5-cbab4c308510\") " pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a431a02-a3be-4869-9b22-5a62f3308d91-tmp-dir\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.235838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-cni-bin\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-sys-fs\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a431a02-a3be-4869-9b22-5a62f3308d91-hosts-file\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-conf-dir\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-os-release\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235901    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee604215-f88c-489c-9285-c937f297c47d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.235957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-kubelet-config\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.235999    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.236073    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:17.736053221 +0000 UTC m=+3.011297744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.236215    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.236265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-host-var-lib-kubelet\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.236298    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:17.736280712 +0000 UTC m=+3.011525222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.236317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-multus-socket-dir-parent\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.236674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.236376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee604215-f88c-489c-9285-c937f297c47d-os-release\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.238676 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.238652    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:17.238771 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.238681    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:17.238771 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.238696    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:17.238771 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.238761    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:38:17.738745327 +0000 UTC m=+3.013989842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:17.239497 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.239475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c9a2392-d69a-4447-baf5-cbab4c308510-agent-certs\") pod \"konnectivity-agent-tqh88\" (UID: \"6c9a2392-d69a-4447-baf5-cbab4c308510\") " pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.240117 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.240096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd8dx\" (UniqueName: \"kubernetes.io/projected/0176da58-049e-421f-8ec0-0eabc63e7228-kube-api-access-hd8dx\") pod \"iptables-alerter-gznm5\" (UID: \"0176da58-049e-421f-8ec0-0eabc63e7228\") " pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.242942 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.242917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xntmd\" (UniqueName: \"kubernetes.io/projected/ee604215-f88c-489c-9285-c937f297c47d-kube-api-access-xntmd\") pod \"multus-additional-cni-plugins-s8v5d\" (UID: \"ee604215-f88c-489c-9285-c937f297c47d\") " pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.244235 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.244026    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jztv\" (UniqueName: \"kubernetes.io/projected/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-kube-api-access-5jztv\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.245820 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.245254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zzb5\" (UniqueName: \"kubernetes.io/projected/e034cdf9-4e41-4a1c-a5f5-9e87f43ef387-kube-api-access-7zzb5\") pod \"multus-sc2mt\" (UID: \"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387\") " pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.245820 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.245264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrpp4\" (UniqueName: \"kubernetes.io/projected/7a431a02-a3be-4869-9b22-5a62f3308d91-kube-api-access-nrpp4\") pod \"node-resolver-tgj6m\" (UID: \"7a431a02-a3be-4869-9b22-5a62f3308d91\") " pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.251579 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.251496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbdb\" (UniqueName: \"kubernetes.io/projected/11f3d7eb-a8b7-4366-bc1d-30b7f621b98e-kube-api-access-hkbdb\") pod \"aws-ebs-csi-driver-node-tpv55\" (UID: \"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.335258 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-node-log\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-cni-netd\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c20c5d6b-f67d-4bd2-a286-9570402675df-ovn-node-metrics-cert\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-lib-modules\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.335428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-slash\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-etc-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-systemd-units\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-log-socket\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-ovnkube-script-lib\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-modprobe-d\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysctl-conf\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysctl-d\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-sys\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-systemd\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-var-lib-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.335717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-cni-bin\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkfhw\" (UniqueName: \"kubernetes.io/projected/c20c5d6b-f67d-4bd2-a286-9570402675df-kube-api-access-wkfhw\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-env-overrides\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-var-lib-kubelet\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-host\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5065019-e701-4274-8316-988546bdeffa-host\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4696b71f-8d64-4d28-b974-e05e77d7ed19-tmp\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4q4\" (UniqueName: \"kubernetes.io/projected/a5065019-e701-4274-8316-988546bdeffa-kube-api-access-bh4q4\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-run\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-kubernetes\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-kubelet\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.335992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-ovn\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-run-ovn-kubernetes\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-systemd\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-tuned\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qk8\" (UniqueName: \"kubernetes.io/projected/4696b71f-8d64-4d28-b974-e05e77d7ed19-kube-api-access-59qk8\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-run-netns\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-ovnkube-config\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.336317 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5065019-e701-4274-8316-988546bdeffa-serviceca\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.337188 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysconfig\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.337188 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysconfig\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.337188 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336398    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-node-log\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.337188 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-cni-netd\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.337188 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.336475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.338222 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-env-overrides\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.338385 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-lib-modules\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.338496 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-slash\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.338496 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-etc-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.338602 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-systemd-units\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.338602 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.338700 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.338614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-log-socket\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.339112 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339087    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-ovnkube-script-lib\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-modprobe-d\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-cni-bin\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339343    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-systemd\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysctl-conf\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-kubelet\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-sys\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-sysctl-d\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-host\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5065019-e701-4274-8316-988546bdeffa-host\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-var-lib-openvswitch\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-var-lib-kubelet\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-run\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-kubernetes\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339877    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-run-ovn-kubernetes\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-run-ovn\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339976    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-systemd\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.339989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c20c5d6b-f67d-4bd2-a286-9570402675df-host-run-netns\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.340349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.340337    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c20c5d6b-f67d-4bd2-a286-9570402675df-ovn-node-metrics-cert\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.341285 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.340389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5065019-e701-4274-8316-988546bdeffa-serviceca\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.341285 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.340702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c20c5d6b-f67d-4bd2-a286-9570402675df-ovnkube-config\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.342124 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.342099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4696b71f-8d64-4d28-b974-e05e77d7ed19-tmp\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.342223 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.342207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4696b71f-8d64-4d28-b974-e05e77d7ed19-etc-tuned\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.347943 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.347887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4q4\" (UniqueName: \"kubernetes.io/projected/a5065019-e701-4274-8316-988546bdeffa-kube-api-access-bh4q4\") pod \"node-ca-rx6gq\" (UID: \"a5065019-e701-4274-8316-988546bdeffa\") " pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.348954 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.348923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkfhw\" (UniqueName: \"kubernetes.io/projected/c20c5d6b-f67d-4bd2-a286-9570402675df-kube-api-access-wkfhw\") pod \"ovnkube-node-xv9hj\" (UID: \"c20c5d6b-f67d-4bd2-a286-9570402675df\") " pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.349249 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.349210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qk8\" (UniqueName: \"kubernetes.io/projected/4696b71f-8d64-4d28-b974-e05e77d7ed19-kube-api-access-59qk8\") pod \"tuned-2rwct\" (UID: \"4696b71f-8d64-4d28-b974-e05e77d7ed19\") " pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.427404 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.427367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gznm5"
Jul 20 13:38:17.438024 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.437990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8v5d"
Jul 20 13:38:17.448566 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.448240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:17.456418 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.456377    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55"
Jul 20 13:38:17.467420 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.467390    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tgj6m"
Jul 20 13:38:17.476519 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.476477    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sc2mt"
Jul 20 13:38:17.483634 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.483608    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:17.495550 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.495524    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2rwct"
Jul 20 13:38:17.501729 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.501708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx6gq"
Jul 20 13:38:17.740199 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.740102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:17.740199 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.740141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:17.740404 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:17.740225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:17.740404 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740338    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:17.740404 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740346    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:17.740508 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740403    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:18.740386346 +0000 UTC m=+4.015630855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:17.740508 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740441    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:18.740419286 +0000 UTC m=+4.015663795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:17.740508 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740348    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:17.740508 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740480    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:17.740508 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740498    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:17.740672 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:17.740552    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:38:18.740540095 +0000 UTC m=+4.015784613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:18.173494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:18.173352    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 13:33:17 +0000 UTC" deadline="2028-04-25 03:06:33.211676586 +0000 UTC"
Jul 20 13:38:18.173494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:18.173442    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15469h28m15.038244602s"
Jul 20 13:38:18.457812 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.457701    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9a2392_d69a_4447_baf5_cbab4c308510.slice/crio-0a806154ef721102a2f56973d42887d3efcea28c9b75eee0686f0cd8dec87e7d WatchSource:0}: Error finding container 0a806154ef721102a2f56973d42887d3efcea28c9b75eee0686f0cd8dec87e7d: Status 404 returned error can't find the container with id 0a806154ef721102a2f56973d42887d3efcea28c9b75eee0686f0cd8dec87e7d
Jul 20 13:38:18.459416 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.459381    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20c5d6b_f67d_4bd2_a286_9570402675df.slice/crio-d9f0db090e59647310cbe3979365e9264cbb62c88b53bdab2e2abaeb51565f40 WatchSource:0}: Error finding container d9f0db090e59647310cbe3979365e9264cbb62c88b53bdab2e2abaeb51565f40: Status 404 returned error can't find the container with id d9f0db090e59647310cbe3979365e9264cbb62c88b53bdab2e2abaeb51565f40
Jul 20 13:38:18.462534 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.462508    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f3d7eb_a8b7_4366_bc1d_30b7f621b98e.slice/crio-84a4140e1625899efab0b27a52c8b73b33732c8773a4555e90129228a583088b WatchSource:0}: Error finding container 84a4140e1625899efab0b27a52c8b73b33732c8773a4555e90129228a583088b: Status 404 returned error can't find the container with id 84a4140e1625899efab0b27a52c8b73b33732c8773a4555e90129228a583088b
Jul 20 13:38:18.466330 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.466243    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee604215_f88c_489c_9285_c937f297c47d.slice/crio-1e688350cb67753a1a976b1e6fd7139bee38c30d038857810b1e532d65b8e202 WatchSource:0}: Error finding container 1e688350cb67753a1a976b1e6fd7139bee38c30d038857810b1e532d65b8e202: Status 404 returned error can't find the container with id 1e688350cb67753a1a976b1e6fd7139bee38c30d038857810b1e532d65b8e202
Jul 20 13:38:18.472492 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.472370    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5065019_e701_4274_8316_988546bdeffa.slice/crio-e7ed703f36da0c7452dac76435dc922a79b31701655d2c5ce53bc32bc3042450 WatchSource:0}: Error finding container e7ed703f36da0c7452dac76435dc922a79b31701655d2c5ce53bc32bc3042450: Status 404 returned error can't find the container with id e7ed703f36da0c7452dac76435dc922a79b31701655d2c5ce53bc32bc3042450
Jul 20 13:38:18.474342 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.474295    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4696b71f_8d64_4d28_b974_e05e77d7ed19.slice/crio-c46862da18a4a6fe69394adbc03c79842b1fe4b9064bd5cd28bc5e98d1385bcf WatchSource:0}: Error finding container c46862da18a4a6fe69394adbc03c79842b1fe4b9064bd5cd28bc5e98d1385bcf: Status 404 returned error can't find the container with id c46862da18a4a6fe69394adbc03c79842b1fe4b9064bd5cd28bc5e98d1385bcf
Jul 20 13:38:18.475651 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:18.475356    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a431a02_a3be_4869_9b22_5a62f3308d91.slice/crio-c83945db4d3c8dc8b1122b4a38e43b6f75f42b1b02252e009ff58b8349167af4 WatchSource:0}: Error finding container c83945db4d3c8dc8b1122b4a38e43b6f75f42b1b02252e009ff58b8349167af4: Status 404 returned error can't find the container with id c83945db4d3c8dc8b1122b4a38e43b6f75f42b1b02252e009ff58b8349167af4
Jul 20 13:38:18.748038 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:18.747816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:18.748075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:18.748102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748015    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748136    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748147    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748199    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748218    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:18.748263 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748258    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:38:20.748238424 +0000 UTC m=+6.023482946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:18.748559 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748281    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:20.748272566 +0000 UTC m=+6.023517080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:18.748559 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:18.748300    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:20.748294764 +0000 UTC m=+6.023539271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:19.174004 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.173904    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 13:33:17 +0000 UTC" deadline="2028-01-30 08:04:14.701682192 +0000 UTC"
Jul 20 13:38:19.174004 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.173950    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13410h25m55.527737033s"
Jul 20 13:38:19.187401 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.187370    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:19.187607 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:19.187516    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:19.188039 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.188014    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:19.188177 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:19.188134    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:19.188258 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.188215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:19.188365 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:19.188341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:19.204099 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.203838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqh88" event={"ID":"6c9a2392-d69a-4447-baf5-cbab4c308510","Type":"ContainerStarted","Data":"0a806154ef721102a2f56973d42887d3efcea28c9b75eee0686f0cd8dec87e7d"}
Jul 20 13:38:19.211707 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.211012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal" event={"ID":"1c5424a690786bcc920675f485fb0103","Type":"ContainerStarted","Data":"eb755188dd4e09ff9b7c964efaa727d02dedb5cc4eba5710c3a4268daeb5dcba"}
Jul 20 13:38:19.218976 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.218325    2559 generic.go:356] "Generic (PLEG): container finished" podID="1890c873ddae72ffbd5b00871ebc86f2" containerID="78e818032e59c15b6255a17034804fafa2730c6d96307ef671cb402a05392d0a" exitCode=0
Jul 20 13:38:19.218976 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.218396    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal" event={"ID":"1890c873ddae72ffbd5b00871ebc86f2","Type":"ContainerDied","Data":"78e818032e59c15b6255a17034804fafa2730c6d96307ef671cb402a05392d0a"}
Jul 20 13:38:19.227801 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.227207    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-139.ec2.internal" podStartSLOduration=2.227184928 podStartE2EDuration="2.227184928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:19.226447917 +0000 UTC m=+4.501692449" watchObservedRunningTime="2026-07-20 13:38:19.227184928 +0000 UTC m=+4.502429461"
Jul 20 13:38:19.229616 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.229527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sc2mt" event={"ID":"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387","Type":"ContainerStarted","Data":"fabd9a9ec2556cf1dc73cb8eb85bdd4f9f29e5a65131105ee970742f60f31cf2"}
Jul 20 13:38:19.236457 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.236365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gznm5" event={"ID":"0176da58-049e-421f-8ec0-0eabc63e7228","Type":"ContainerStarted","Data":"721b501b3fa7457956aa19946036e2b5b90ebb75f9092f7cacee77d9c459a66d"}
Jul 20 13:38:19.248748 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.248705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx6gq" event={"ID":"a5065019-e701-4274-8316-988546bdeffa","Type":"ContainerStarted","Data":"e7ed703f36da0c7452dac76435dc922a79b31701655d2c5ce53bc32bc3042450"}
Jul 20 13:38:19.262490 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.262454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"d9f0db090e59647310cbe3979365e9264cbb62c88b53bdab2e2abaeb51565f40"}
Jul 20 13:38:19.271973 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.271888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2rwct" event={"ID":"4696b71f-8d64-4d28-b974-e05e77d7ed19","Type":"ContainerStarted","Data":"c46862da18a4a6fe69394adbc03c79842b1fe4b9064bd5cd28bc5e98d1385bcf"}
Jul 20 13:38:19.279846 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.279810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tgj6m" event={"ID":"7a431a02-a3be-4869-9b22-5a62f3308d91","Type":"ContainerStarted","Data":"c83945db4d3c8dc8b1122b4a38e43b6f75f42b1b02252e009ff58b8349167af4"}
Jul 20 13:38:19.306782 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.306705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerStarted","Data":"1e688350cb67753a1a976b1e6fd7139bee38c30d038857810b1e532d65b8e202"}
Jul 20 13:38:19.316483 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:19.316444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55" event={"ID":"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e","Type":"ContainerStarted","Data":"84a4140e1625899efab0b27a52c8b73b33732c8773a4555e90129228a583088b"}
Jul 20 13:38:20.356047 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:20.355609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal" event={"ID":"1890c873ddae72ffbd5b00871ebc86f2","Type":"ContainerStarted","Data":"8cea496de522fa51699f5cfead81b8714f5ad689a7eafd567e06be03beaf63d7"}
Jul 20 13:38:20.373858 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:20.373168    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-139.ec2.internal" podStartSLOduration=3.373146528 podStartE2EDuration="3.373146528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:20.372929353 +0000 UTC m=+5.648173887" watchObservedRunningTime="2026-07-20 13:38:20.373146528 +0000 UTC m=+5.648391063"
Jul 20 13:38:20.766927 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:20.766832    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:20.766927 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:20.766892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:20.767170 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:20.766957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:20.767261 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767204    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:20.767261 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767252    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:20.767376 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767268    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:20.767376 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767332    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:38:24.767310774 +0000 UTC m=+10.042555287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:20.767813 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767790    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:20.767908 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767852    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:24.767835697 +0000 UTC m=+10.043080210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:20.767974 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767910    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:20.767974 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:20.767942    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:24.767930955 +0000 UTC m=+10.043175471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:21.191497 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:21.191406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:21.191687 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:21.191584    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:21.192369 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:21.192006    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:21.192369 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:21.192108    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:21.192369 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:21.192149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:21.192369 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:21.192221    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:23.188353 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:23.188313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:23.188816 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:23.188451    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:23.188816 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:23.188624    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:23.188816 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:23.188736    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:23.189003 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:23.188888    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:23.189060 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:23.188998    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:24.809560 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:24.809517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:24.809591    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:24.809653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809724    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809752    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809767    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809770    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809779    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809829    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:32.809810381 +0000 UTC m=+18.085054905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809855    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:32.809835802 +0000 UTC m=+18.085080336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:24.810059 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:24.809880    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:38:32.809867574 +0000 UTC m=+18.085112087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:25.188186 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:25.188081    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:25.188353 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:25.188218    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:25.189706 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:25.189681    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:25.189880 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:25.189780    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:25.189880 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:25.189846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:25.189994 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:25.189934    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:27.186662 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:27.186625    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:27.187203 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:27.186745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:27.187203 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:27.186747    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:27.187203 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:27.186826    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:27.187203 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:27.186622    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:27.187203 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:27.186906    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:29.186470 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:29.186433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:29.186935 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:29.186432    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:29.186935 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:29.186549    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:29.186935 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:29.186628    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:29.186935 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:29.186712    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:29.186935 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:29.186799    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:31.190266 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:31.190234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:31.190694 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:31.190238    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:31.190694 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:31.190342    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:31.190694 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:31.190242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:31.190694 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:31.190470    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:31.190694 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:31.190566    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:32.870108 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:32.870063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:32.870124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:32.870144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870251    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870256    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870281    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870303    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870316    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870319    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:48.870299839 +0000 UTC m=+34.145544349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870339    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:48.870328828 +0000 UTC m=+34.145573339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:32.870637 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:32.870361    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:38:48.870345071 +0000 UTC m=+34.145589594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:33.190811 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:33.190732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:33.190957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:33.190845    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:33.190957 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:33.190854    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:33.190957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:33.190871    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:33.190957 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:33.190945    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:33.191117 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:33.191056    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:35.189498 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:35.189466    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:35.189965 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:35.189464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:35.189965 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:35.189581    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:35.189965 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:35.189640    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:35.189965 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:35.189464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:35.189965 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:35.189738    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:37.186252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:37.186216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:37.186252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:37.186239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:37.186815 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:37.186225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:37.186815 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:37.186753    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:37.186943 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:37.186907    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:37.187070 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:37.187045    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:39.186921 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.186545    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:39.187700 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.186573    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:39.187700 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:39.186950    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:39.187700 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.186600    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:39.187700 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:39.187025    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:39.187700 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:39.187087    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:39.410056 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.410017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2rwct" event={"ID":"4696b71f-8d64-4d28-b974-e05e77d7ed19","Type":"ContainerStarted","Data":"311734c6f21ab6466112954108f2b339ca4c9306805e163211313b4aa15b2519"}
Jul 20 13:38:39.411446 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.411420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tgj6m" event={"ID":"7a431a02-a3be-4869-9b22-5a62f3308d91","Type":"ContainerStarted","Data":"faa044d90fa158f27c6867a8965283655396736b2735202975c24021e5f2f2d5"}
Jul 20 13:38:39.412887 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.412868    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee604215-f88c-489c-9285-c937f297c47d" containerID="81faa896fd191e2c2f423909f86ab5c411656ece705bcb086c05e634a44156d6" exitCode=0
Jul 20 13:38:39.413008 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.412925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerDied","Data":"81faa896fd191e2c2f423909f86ab5c411656ece705bcb086c05e634a44156d6"}
Jul 20 13:38:39.414457 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.414441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55" event={"ID":"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e","Type":"ContainerStarted","Data":"ae7c96201e7d61905fab352f40d881027f872ad4fe758789cc38801350a19269"}
Jul 20 13:38:39.415894 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.415871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqh88" event={"ID":"6c9a2392-d69a-4447-baf5-cbab4c308510","Type":"ContainerStarted","Data":"8461529ca1d52f4d4f1cbb66477b7c7265d9a89d032cbb2ae8d24e057fd36733"}
Jul 20 13:38:39.417343 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.417321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sc2mt" event={"ID":"e034cdf9-4e41-4a1c-a5f5-9e87f43ef387","Type":"ContainerStarted","Data":"3a16fca709df16c1f6508993278a25703101f068e83d79c504a16e39049fd6d4"}
Jul 20 13:38:39.418592 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.418574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx6gq" event={"ID":"a5065019-e701-4274-8316-988546bdeffa","Type":"ContainerStarted","Data":"dbd8022a52f454a47ad24bad309fe5da29c215829ebe6ba60a010884ea80d3f0"}
Jul 20 13:38:39.421289 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.421271    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"ea096cf67380f1a87da2520c04fccaa4956bed0a81f733220b7b4624779d0da6"}
Jul 20 13:38:39.421370 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.421332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"daf77a7add13028b1a3715d83fef1fb9b7652f1669b12d0e94af5b4c29c67136"}
Jul 20 13:38:39.421370 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.421362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"d58ac495ca8a0ac20b97cd2aff964b007ea620ce54c0a8014a3102a90bcaa055"}
Jul 20 13:38:39.421451 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.421390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"faa65df2977a4baf1fad1ffe755fa31b6e519a8c62d24cd95fdc6653d7d8c5da"}
Jul 20 13:38:39.421451 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.421418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"6e4217f1699480df5c4fcdbe4e87249dd39ce7b19849e47b500aad91ac659ea5"}
Jul 20 13:38:39.421451 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.421444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"6e89c8337121ea2dfe002021260d30ea9916301a55dd7102c65c072c95bf3bf5"}
Jul 20 13:38:39.429830 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.429793    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2rwct" podStartSLOduration=3.5391768040000002 podStartE2EDuration="23.42978193s" totalImagesPullingTime="19.890605126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:39.429712855 +0000 UTC m=+24.704957384" watchObservedRunningTime="2026-07-20 13:38:39.42978193 +0000 UTC m=+24.705026459"
Jul 20 13:38:39.445566 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.445480    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sc2mt" podStartSLOduration=3.487243823 podStartE2EDuration="23.445466477s" totalImagesPullingTime="19.958222654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:39.445076249 +0000 UTC m=+24.720320781" watchObservedRunningTime="2026-07-20 13:38:39.445466477 +0000 UTC m=+24.720711006"
Jul 20 13:38:39.461135 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.461090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tqh88" podStartSLOduration=11.501931193 podStartE2EDuration="23.461077385s" totalImagesPullingTime="11.959146192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:39.460824988 +0000 UTC m=+24.736069518" watchObservedRunningTime="2026-07-20 13:38:39.461077385 +0000 UTC m=+24.736321914"
Jul 20 13:38:39.482077 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.482028    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rx6gq" podStartSLOduration=3.588293431 podStartE2EDuration="23.482012998s" totalImagesPullingTime="19.893719567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:39.48163304 +0000 UTC m=+24.756877569" watchObservedRunningTime="2026-07-20 13:38:39.482012998 +0000 UTC m=+24.757257526"
Jul 20 13:38:39.527602 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:39.527539    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tgj6m" podStartSLOduration=3.63681937 podStartE2EDuration="23.527514855s" totalImagesPullingTime="19.890695485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:39.52699174 +0000 UTC m=+24.802236270" watchObservedRunningTime="2026-07-20 13:38:39.527514855 +0000 UTC m=+24.802759385"
Jul 20 13:38:40.429701 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:40.429671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gznm5" event={"ID":"0176da58-049e-421f-8ec0-0eabc63e7228","Type":"ContainerStarted","Data":"c601e28e1e5b15a86c2b5954a4699be6aafea0b0820d1b2585d696be04e5242a"}
Jul 20 13:38:40.444327 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:40.444270    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gznm5" podStartSLOduration=4.548455491 podStartE2EDuration="24.444247987s" totalImagesPullingTime="19.895792496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:40.443463437 +0000 UTC m=+25.718707965" watchObservedRunningTime="2026-07-20 13:38:40.444247987 +0000 UTC m=+25.719492518"
Jul 20 13:38:40.530268 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:40.530240    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 13:38:40.681476 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:40.681386    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:40.682031 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:40.682006    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:41.187144 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.187022    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T13:38:40.530261407Z","UUID":"b75366cf-2da0-40e0-8a02-ec4b1aadf8d4","Handler":null,"Name":"","Endpoint":""}
Jul 20 13:38:41.188268 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.188139    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:41.188483 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:41.188288    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:41.188705 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.188686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:41.188803 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:41.188779    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:41.189042 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.188964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:41.189094 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:41.189072    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:41.189285 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.189265    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 13:38:41.189414 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.189309    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 13:38:41.432360 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.432263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55" event={"ID":"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e","Type":"ContainerStarted","Data":"56a161850130c8499077312584360f98c35477012dd3a499f10bce58038c8e27"}
Jul 20 13:38:41.435369 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:41.435340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"3355b4028861fb7affa32b963f22892b1448c3d780b8456f3e87093a54d3cd3e"}
Jul 20 13:38:42.440989 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:42.440961    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 13:38:42.440989 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:42.440980    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55" event={"ID":"11f3d7eb-a8b7-4366-bc1d-30b7f621b98e","Type":"ContainerStarted","Data":"8d037d840c22a7395f742a21ce5eb2c74eb1ac78c91226282cdc9b409f927516"}
Jul 20 13:38:42.460716 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:42.460652    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tpv55" podStartSLOduration=3.554144596 podStartE2EDuration="26.460626148s" totalImagesPullingTime="22.906481552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:42.460020421 +0000 UTC m=+27.735264949" watchObservedRunningTime="2026-07-20 13:38:42.460626148 +0000 UTC m=+27.735870678"
Jul 20 13:38:42.725403 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:42.725318    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:42.726008 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:42.725974    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tqh88"
Jul 20 13:38:43.187045 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:43.186948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:43.187225 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:43.187076    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:43.187225 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:43.187108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:43.187225 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:43.187199    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:43.187381 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:43.187262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:43.187381 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:43.187321    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:45.187328 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.187060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:45.188133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.187145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:45.188133 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:45.187365    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:45.188133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.187197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:45.188133 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:45.187464    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:45.188133 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:45.187517    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:45.449884 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.449797    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee604215-f88c-489c-9285-c937f297c47d" containerID="17ab39a29c4f48675a836116b77f1e379e7940abdc28ddb244160ccb852552a1" exitCode=0
Jul 20 13:38:45.450043 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.449886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerDied","Data":"17ab39a29c4f48675a836116b77f1e379e7940abdc28ddb244160ccb852552a1"}
Jul 20 13:38:45.453617 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.453587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" event={"ID":"c20c5d6b-f67d-4bd2-a286-9570402675df","Type":"ContainerStarted","Data":"43e22ae3ee1d654a288d3b3b9169c8b5547679337377cebdeb8376e7fd492e33"}
Jul 20 13:38:45.453864 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.453847    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:45.471220 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.471189    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:45.511004 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:45.510949    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj" podStartSLOduration=9.526643989 podStartE2EDuration="29.51093412s" totalImagesPullingTime="19.984290131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:45.510817122 +0000 UTC m=+30.786061653" watchObservedRunningTime="2026-07-20 13:38:45.51093412 +0000 UTC m=+30.786178649"
Jul 20 13:38:46.456640 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.456380    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:46.457179 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.456700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:46.472502 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.472469    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:38:46.856804 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.856683    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7j7rl"]
Jul 20 13:38:46.856804 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.856787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:46.856958 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:46.856870    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:46.867391 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.867258    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5q5q"]
Jul 20 13:38:46.867528 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.867461    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ppt7"]
Jul 20 13:38:46.867969 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.867945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:46.868060 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:46.867945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:46.868102 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:46.868058    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:46.868211 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:46.868191    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:47.459899 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:47.459863    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee604215-f88c-489c-9285-c937f297c47d" containerID="453b750fdefd4594d126c9332bfd22ebffe2a94642fce33284eb1c31ef3ad93c" exitCode=0
Jul 20 13:38:47.460383 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:47.459961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerDied","Data":"453b750fdefd4594d126c9332bfd22ebffe2a94642fce33284eb1c31ef3ad93c"}
Jul 20 13:38:48.186467 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.186372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:48.186467 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.186400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:48.186467 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.186408    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:48.186721 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.186513    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:48.186721 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.186601    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:48.186721 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.186688    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:48.464424 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.464335    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee604215-f88c-489c-9285-c937f297c47d" containerID="e00815315a89cac0561ab95c104162f410fcb9c106a37ad4698695e3973ae8e8" exitCode=0
Jul 20 13:38:48.464750 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.464426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerDied","Data":"e00815315a89cac0561ab95c104162f410fcb9c106a37ad4698695e3973ae8e8"}
Jul 20 13:38:48.884244 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.884146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:48.884244 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.884201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884277    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884290    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884304    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884313    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pcgmh for pod openshift-network-diagnostics/network-check-target-7j7rl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884321    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs podName:79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:20.884308126 +0000 UTC m=+66.159552632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs") pod "network-metrics-daemon-h5q5q" (UID: "79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884351    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh podName:bb2d0adf-bcdb-4c71-8caa-9db18fea84ff nodeName:}" failed. No retries permitted until 2026-07-20 13:39:20.884339597 +0000 UTC m=+66.159584104 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcgmh" (UniqueName: "kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh") pod "network-check-target-7j7rl" (UID: "bb2d0adf-bcdb-4c71-8caa-9db18fea84ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:38:48.884439 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:48.884372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:48.884681 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884457    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:48.884681 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:48.884504    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret podName:2b5f069d-82bd-4c58-8fef-b54c87b9f6a0 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:20.884490275 +0000 UTC m=+66.159734783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret") pod "global-pull-secret-syncer-5ppt7" (UID: "2b5f069d-82bd-4c58-8fef-b54c87b9f6a0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:38:50.187136 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:50.187094    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:50.187136 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:50.187134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:50.187627 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:50.187211    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:50.187627 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:50.187225    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5q5q" podUID="79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1"
Jul 20 13:38:50.187627 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:50.187308    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7j7rl" podUID="bb2d0adf-bcdb-4c71-8caa-9db18fea84ff"
Jul 20 13:38:50.187627 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:50.187406    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ppt7" podUID="2b5f069d-82bd-4c58-8fef-b54c87b9f6a0"
Jul 20 13:38:51.014104 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.013909    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-139.ec2.internal" event="NodeReady"
Jul 20 13:38:51.014339 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.014250    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 13:38:51.049991 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.049956    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"]
Jul 20 13:38:51.053743 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.053705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.055146 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.054301    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"]
Jul 20 13:38:51.056733 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.056707    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.057140 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.057122    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 13:38:51.057292 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.057141    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.057292 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.057253    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-stk7v\""
Jul 20 13:38:51.058146 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.058131    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64f8648b85-2mk59"]
Jul 20 13:38:51.058291 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.058276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"
Jul 20 13:38:51.061459 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.061439    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.061723 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.061461    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.061723 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.061533    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-f8pcx\""
Jul 20 13:38:51.061723 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.061653    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-d72ts"]
Jul 20 13:38:51.061915 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.061814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.065138 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.065117    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"]
Jul 20 13:38:51.065412 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.065395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.065498 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.065450    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 13:38:51.066040 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.066011    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 13:38:51.066132 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.066093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d6whh\""
Jul 20 13:38:51.066246 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.066230    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 13:38:51.068145 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.067952    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.068145 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.068134    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 20 13:38:51.068818 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.068799    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"]
Jul 20 13:38:51.069428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.068928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.069428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.068944    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 20 13:38:51.069428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.068953    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.069428 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.068932    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g5xp5\""
Jul 20 13:38:51.076368 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.076332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.076878 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.076847    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.078878 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.078853    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 20 13:38:51.079689 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.079657    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bnpcw\""
Jul 20 13:38:51.080643 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.080122    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-lfcx6"]
Jul 20 13:38:51.081805 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.081779    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 13:38:51.082049 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.082027    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 20 13:38:51.083004 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.082291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.084664 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.084644    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 20 13:38:51.085004 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.084975    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-prmz9\""
Jul 20 13:38:51.085096 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.084928    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.085311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.085292    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 13:38:51.085499 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.085480    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.086037 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"]
Jul 20 13:38:51.086122 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086061    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"]
Jul 20 13:38:51.086122 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-d72ts"]
Jul 20 13:38:51.086122 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-lfcx6"]
Jul 20 13:38:51.086122 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086117    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f8648b85-2mk59"]
Jul 20 13:38:51.086344 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086137    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qbr68"]
Jul 20 13:38:51.086344 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086152    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 13:38:51.086344 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.086283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.090076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.090203    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.090274    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.090434    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.090453    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jwjjz\""
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.090819    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"]
Jul 20 13:38:51.091461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.091255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.094930 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.094912    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 13:38:51.095093 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.095037    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 13:38:51.095193 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.095041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbmz6\""
Jul 20 13:38:51.095485 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.095462    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2m52s"]
Jul 20 13:38:51.095810 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.095794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.096029 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.096010    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 20 13:38:51.098377 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.098362    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 13:38:51.098494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.098413    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 13:38:51.098562 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.098414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8jsgq\""
Jul 20 13:38:51.098947 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.098930    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"]
Jul 20 13:38:51.099435 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.099411    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.102152 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.102132    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"]
Jul 20 13:38:51.102277 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.102235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"
Jul 20 13:38:51.103187 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.103140    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.103508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.103370    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.103508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.103401    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2m9zn\""
Jul 20 13:38:51.103508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.103431    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 13:38:51.106021 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.106000    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qbr68"]
Jul 20 13:38:51.106110 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.106100    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:38:51.106426 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.106343    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:38:51.106608 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.106559    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gwfb6\""
Jul 20 13:38:51.108508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.108076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"]
Jul 20 13:38:51.113995 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.113892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"]
Jul 20 13:38:51.115361 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.115304    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"]
Jul 20 13:38:51.119957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.119930    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2m52s"]
Jul 20 13:38:51.201768 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-trusted-ca\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.201768 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-serving-cert\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgcbf\" (UniqueName: \"kubernetes.io/projected/536c169b-0244-4932-b303-7e06a972906f-kube-api-access-sgcbf\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9vr\" (UniqueName: \"kubernetes.io/projected/104176dc-4e6f-4a05-b180-7e2517289df2-kube-api-access-wq9vr\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8cz\" (UniqueName: \"kubernetes.io/projected/f6989115-a0ea-4c88-ab51-b3187ec6157f-kube-api-access-gq8cz\") pod \"ingress-canary-2m52s\" (UID: \"f6989115-a0ea-4c88-ab51-b3187ec6157f\") " pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglvb\" (UniqueName: \"kubernetes.io/projected/d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176-kube-api-access-zglvb\") pod \"network-check-source-7bc5b6bf85-pdzvp\" (UID: \"d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.201982    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-image-registry-private-configuration\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwcf6\" (UniqueName: \"kubernetes.io/projected/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-kube-api-access-xwcf6\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-bound-sa-token\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6krfg\" (UniqueName: \"kubernetes.io/projected/5fac08ed-7798-439b-93f0-ca7635b58803-kube-api-access-6krfg\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-tmp\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-service-ca-bundle\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.202311 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-certificates\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-installation-pull-secrets\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/536c169b-0244-4932-b303-7e06a972906f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fac08ed-7798-439b-93f0-ca7635b58803-tmp-dir\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/104176dc-4e6f-4a05-b180-7e2517289df2-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4nlc\" (UniqueName: \"kubernetes.io/projected/93b6743d-2b58-4097-9f9d-ba0c15b65c85-kube-api-access-b4nlc\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/536c169b-0244-4932-b303-7e06a972906f-config\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f19134bd-15a2-4e41-b5e4-a2301e4e100a-ca-trust-extracted\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202501    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn224\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-kube-api-access-rn224\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6989115-a0ea-4c88-ab51-b3187ec6157f-cert\") pod \"ingress-canary-2m52s\" (UID: \"f6989115-a0ea-4c88-ab51-b3187ec6157f\") " pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/512f33c9-f4f1-4202-9881-15a6398d5e9f-config\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcx52\" (UniqueName: \"kubernetes.io/projected/a35db5e6-9f20-4452-bd97-518fae670e9d-kube-api-access-hcx52\") pod \"volume-data-source-validator-78cf4c6f6-qpnzg\" (UID: \"a35db5e6-9f20-4452-bd97-518fae670e9d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202632    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/104176dc-4e6f-4a05-b180-7e2517289df2-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-snapshots\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.202984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/512f33c9-f4f1-4202-9881-15a6398d5e9f-serving-cert\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.203421 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512f33c9-f4f1-4202-9881-15a6398d5e9f-trusted-ca\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.203421 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fac08ed-7798-439b-93f0-ca7635b58803-config-volume\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.203421 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e6cd64f-2485-49f1-93e5-492272ffdbac-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.203421 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.202840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq9n2\" (UniqueName: \"kubernetes.io/projected/512f33c9-f4f1-4202-9881-15a6398d5e9f-kube-api-access-nq9n2\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.265145 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.265105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:51.303672 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.303629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fac08ed-7798-439b-93f0-ca7635b58803-tmp-dir\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.303863 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.303682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/104176dc-4e6f-4a05-b180-7e2517289df2-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.303863 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.303815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4nlc\" (UniqueName: \"kubernetes.io/projected/93b6743d-2b58-4097-9f9d-ba0c15b65c85-kube-api-access-b4nlc\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.303863 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.303849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/536c169b-0244-4932-b303-7e06a972906f-config\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.304028 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.303981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f19134bd-15a2-4e41-b5e4-a2301e4e100a-ca-trust-extracted\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.304028 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304020    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn224\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-kube-api-access-rn224\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.304122 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fac08ed-7798-439b-93f0-ca7635b58803-tmp-dir\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.304210 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6989115-a0ea-4c88-ab51-b3187ec6157f-cert\") pod \"ingress-canary-2m52s\" (UID: \"f6989115-a0ea-4c88-ab51-b3187ec6157f\") " pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.304274 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/512f33c9-f4f1-4202-9881-15a6398d5e9f-config\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.304274 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcx52\" (UniqueName: \"kubernetes.io/projected/a35db5e6-9f20-4452-bd97-518fae670e9d-kube-api-access-hcx52\") pod \"volume-data-source-validator-78cf4c6f6-qpnzg\" (UID: \"a35db5e6-9f20-4452-bd97-518fae670e9d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"
Jul 20 13:38:51.304373 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/104176dc-4e6f-4a05-b180-7e2517289df2-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.304373 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-snapshots\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.304373 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.304513 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/512f33c9-f4f1-4202-9881-15a6398d5e9f-serving-cert\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.304513 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512f33c9-f4f1-4202-9881-15a6398d5e9f-trusted-ca\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.304513 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f19134bd-15a2-4e41-b5e4-a2301e4e100a-ca-trust-extracted\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.304513 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fac08ed-7798-439b-93f0-ca7635b58803-config-volume\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.304513 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/536c169b-0244-4932-b303-7e06a972906f-config\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.304513 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e6cd64f-2485-49f1-93e5-492272ffdbac-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq9n2\" (UniqueName: \"kubernetes.io/projected/512f33c9-f4f1-4202-9881-15a6398d5e9f-kube-api-access-nq9n2\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-trusted-ca\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-serving-cert\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgcbf\" (UniqueName: \"kubernetes.io/projected/536c169b-0244-4932-b303-7e06a972906f-kube-api-access-sgcbf\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9vr\" (UniqueName: \"kubernetes.io/projected/104176dc-4e6f-4a05-b180-7e2517289df2-kube-api-access-wq9vr\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8cz\" (UniqueName: \"kubernetes.io/projected/f6989115-a0ea-4c88-ab51-b3187ec6157f-kube-api-access-gq8cz\") pod \"ingress-canary-2m52s\" (UID: \"f6989115-a0ea-4c88-ab51-b3187ec6157f\") " pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglvb\" (UniqueName: \"kubernetes.io/projected/d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176-kube-api-access-zglvb\") pod \"network-check-source-7bc5b6bf85-pdzvp\" (UID: \"d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"
Jul 20 13:38:51.304792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-image-registry-private-configuration\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwcf6\" (UniqueName: \"kubernetes.io/projected/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-kube-api-access-xwcf6\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-bound-sa-token\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6krfg\" (UniqueName: \"kubernetes.io/projected/5fac08ed-7798-439b-93f0-ca7635b58803-kube-api-access-6krfg\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-tmp\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-snapshots\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/512f33c9-f4f1-4202-9881-15a6398d5e9f-config\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.304966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-service-ca-bundle\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.305041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/104176dc-4e6f-4a05-b180-7e2517289df2-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.305105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.305139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-certificates\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.305255 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.305207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-installation-pull-secrets\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.305886 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.305275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/536c169b-0244-4932-b303-7e06a972906f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.305886 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.305386    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:38:51.305886 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.305401    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f8648b85-2mk59: secret "image-registry-tls" not found
Jul 20 13:38:51.305886 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.305461    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls podName:f19134bd-15a2-4e41-b5e4-a2301e4e100a nodeName:}" failed. No retries permitted until 2026-07-20 13:38:51.805443358 +0000 UTC m=+37.080687870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls") pod "image-registry-64f8648b85-2mk59" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a") : secret "image-registry-tls" not found
Jul 20 13:38:51.305886 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.305548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5fac08ed-7798-439b-93f0-ca7635b58803-config-volume\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.306142 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.306100    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 13:38:51.306221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.306174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-trusted-ca\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.306221 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.306187    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert podName:4e6cd64f-2485-49f1-93e5-492272ffdbac nodeName:}" failed. No retries permitted until 2026-07-20 13:38:51.806149049 +0000 UTC m=+37.081393556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-x75kq" (UID: "4e6cd64f-2485-49f1-93e5-492272ffdbac") : secret "networking-console-plugin-cert" not found
Jul 20 13:38:51.306323 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.306292    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 13:38:51.306455 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.306426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-service-ca-bundle\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.306550 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.306442    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls podName:93b6743d-2b58-4097-9f9d-ba0c15b65c85 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:51.806348899 +0000 UTC m=+37.081593409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7hgqx" (UID: "93b6743d-2b58-4097-9f9d-ba0c15b65c85") : secret "samples-operator-tls" not found
Jul 20 13:38:51.306550 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.306458    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:38:51.306550 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.306520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls podName:5fac08ed-7798-439b-93f0-ca7635b58803 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:51.806509368 +0000 UTC m=+37.081753876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls") pod "dns-default-qbr68" (UID: "5fac08ed-7798-439b-93f0-ca7635b58803") : secret "dns-default-metrics-tls" not found
Jul 20 13:38:51.307135 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.307110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-tmp\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.307293 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.307204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e6cd64f-2485-49f1-93e5-492272ffdbac-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.307884 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.307828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/512f33c9-f4f1-4202-9881-15a6398d5e9f-trusted-ca\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.307884 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.307829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-certificates\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.308474 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.308452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.309929 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.309645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-image-registry-private-configuration\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.309929 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.309882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/536c169b-0244-4932-b303-7e06a972906f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.309929 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.309908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/512f33c9-f4f1-4202-9881-15a6398d5e9f-serving-cert\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.310492 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.310250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/104176dc-4e6f-4a05-b180-7e2517289df2-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.310975 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.310954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-serving-cert\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.311213 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.311148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6989115-a0ea-4c88-ab51-b3187ec6157f-cert\") pod \"ingress-canary-2m52s\" (UID: \"f6989115-a0ea-4c88-ab51-b3187ec6157f\") " pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.311862 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.311841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-installation-pull-secrets\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.313307 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.313286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4nlc\" (UniqueName: \"kubernetes.io/projected/93b6743d-2b58-4097-9f9d-ba0c15b65c85-kube-api-access-b4nlc\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.314060 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.314035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq9n2\" (UniqueName: \"kubernetes.io/projected/512f33c9-f4f1-4202-9881-15a6398d5e9f-kube-api-access-nq9n2\") pod \"console-operator-565b7b569d-lfcx6\" (UID: \"512f33c9-f4f1-4202-9881-15a6398d5e9f\") " pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.316706 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.316616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgcbf\" (UniqueName: \"kubernetes.io/projected/536c169b-0244-4932-b303-7e06a972906f-kube-api-access-sgcbf\") pod \"service-ca-operator-5bcbc94c78-fwbbq\" (UID: \"536c169b-0244-4932-b303-7e06a972906f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.316868 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.316790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwcf6\" (UniqueName: \"kubernetes.io/projected/8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af-kube-api-access-xwcf6\") pod \"insights-operator-555d9d7885-d72ts\" (UID: \"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af\") " pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.317154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.317066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn224\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-kube-api-access-rn224\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.317873 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.317852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8cz\" (UniqueName: \"kubernetes.io/projected/f6989115-a0ea-4c88-ab51-b3187ec6157f-kube-api-access-gq8cz\") pod \"ingress-canary-2m52s\" (UID: \"f6989115-a0ea-4c88-ab51-b3187ec6157f\") " pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.318986 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.318962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9vr\" (UniqueName: \"kubernetes.io/projected/104176dc-4e6f-4a05-b180-7e2517289df2-kube-api-access-wq9vr\") pod \"kube-storage-version-migrator-operator-7658d9b749-gplzr\" (UID: \"104176dc-4e6f-4a05-b180-7e2517289df2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.320414 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.320388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcx52\" (UniqueName: \"kubernetes.io/projected/a35db5e6-9f20-4452-bd97-518fae670e9d-kube-api-access-hcx52\") pod \"volume-data-source-validator-78cf4c6f6-qpnzg\" (UID: \"a35db5e6-9f20-4452-bd97-518fae670e9d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"
Jul 20 13:38:51.321360 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.321338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-bound-sa-token\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.321518 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.321497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6krfg\" (UniqueName: \"kubernetes.io/projected/5fac08ed-7798-439b-93f0-ca7635b58803-kube-api-access-6krfg\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.321683 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.321660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglvb\" (UniqueName: \"kubernetes.io/projected/d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176-kube-api-access-zglvb\") pod \"network-check-source-7bc5b6bf85-pdzvp\" (UID: \"d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"
Jul 20 13:38:51.373979 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.373935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:51.382744 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.382711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"
Jul 20 13:38:51.405124 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.405099    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-d72ts"
Jul 20 13:38:51.416604 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.416579    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"
Jul 20 13:38:51.428116 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.428088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"
Jul 20 13:38:51.435395 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.435356    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:38:51.457451 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.456958    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m52s"
Jul 20 13:38:51.462699 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.462309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"
Jul 20 13:38:51.629919 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.629803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg"]
Jul 20 13:38:51.648059 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.647991    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35db5e6_9f20_4452_bd97_518fae670e9d.slice/crio-f9f6a4a2e8c2cdaf6b38088b6407ac83ec879011132dbb9aed0ae3c8427fe999 WatchSource:0}: Error finding container f9f6a4a2e8c2cdaf6b38088b6407ac83ec879011132dbb9aed0ae3c8427fe999: Status 404 returned error can't find the container with id f9f6a4a2e8c2cdaf6b38088b6407ac83ec879011132dbb9aed0ae3c8427fe999
Jul 20 13:38:51.660803 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.653855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-d72ts"]
Jul 20 13:38:51.665913 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.665676    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3e1c70_208a_4bf5_9f60_1f88bdbbf9af.slice/crio-9ac89a69e2d83826c4d08c81a076a43c62991b9298de5618391212a6c1a41cd5 WatchSource:0}: Error finding container 9ac89a69e2d83826c4d08c81a076a43c62991b9298de5618391212a6c1a41cd5: Status 404 returned error can't find the container with id 9ac89a69e2d83826c4d08c81a076a43c62991b9298de5618391212a6c1a41cd5
Jul 20 13:38:51.674138 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.674063    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq"]
Jul 20 13:38:51.678200 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.678148    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536c169b_0244_4932_b303_7e06a972906f.slice/crio-f10ce5267e2b76ca0be9a39b7b3acb6ef8d1ba0766d65f3347c74fa875a8ef91 WatchSource:0}: Error finding container f10ce5267e2b76ca0be9a39b7b3acb6ef8d1ba0766d65f3347c74fa875a8ef91: Status 404 returned error can't find the container with id f10ce5267e2b76ca0be9a39b7b3acb6ef8d1ba0766d65f3347c74fa875a8ef91
Jul 20 13:38:51.690743 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.690568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr"]
Jul 20 13:38:51.695384 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.695319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104176dc_4e6f_4a05_b180_7e2517289df2.slice/crio-7c1ce7affee671aca2538b8d30f9c809d9e2b38fa90c31be37e0d7890fbf6fcc WatchSource:0}: Error finding container 7c1ce7affee671aca2538b8d30f9c809d9e2b38fa90c31be37e0d7890fbf6fcc: Status 404 returned error can't find the container with id 7c1ce7affee671aca2538b8d30f9c809d9e2b38fa90c31be37e0d7890fbf6fcc
Jul 20 13:38:51.711920 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.710730    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-lfcx6"]
Jul 20 13:38:51.712646 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.712581    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2m52s"]
Jul 20 13:38:51.714004 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.713892    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512f33c9_f4f1_4202_9881_15a6398d5e9f.slice/crio-1c2de590ac088c3a17a6dda771b0ac9741c5a151833b82706c7772dc1ca6a305 WatchSource:0}: Error finding container 1c2de590ac088c3a17a6dda771b0ac9741c5a151833b82706c7772dc1ca6a305: Status 404 returned error can't find the container with id 1c2de590ac088c3a17a6dda771b0ac9741c5a151833b82706c7772dc1ca6a305
Jul 20 13:38:51.716537 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.716083    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6989115_a0ea_4c88_ab51_b3187ec6157f.slice/crio-6fd22f137d1700b495127be63e6eac280c50109b6783b6ecf0b147dbd57c43e2 WatchSource:0}: Error finding container 6fd22f137d1700b495127be63e6eac280c50109b6783b6ecf0b147dbd57c43e2: Status 404 returned error can't find the container with id 6fd22f137d1700b495127be63e6eac280c50109b6783b6ecf0b147dbd57c43e2
Jul 20 13:38:51.742941 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.742910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp"]
Jul 20 13:38:51.746441 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:38:51.746406    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b76297_e3b9_4aea_9dbd_fd6a7ccbf176.slice/crio-1c9e6b83adab53bdf1c3ee9f07dfd60b21b46dc87f8557293fcfaaeacb67e5d8 WatchSource:0}: Error finding container 1c9e6b83adab53bdf1c3ee9f07dfd60b21b46dc87f8557293fcfaaeacb67e5d8: Status 404 returned error can't find the container with id 1c9e6b83adab53bdf1c3ee9f07dfd60b21b46dc87f8557293fcfaaeacb67e5d8
Jul 20 13:38:51.816474 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.816444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:51.816660 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.816480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:51.816660 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.816519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:51.816660 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:51.816607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:51.816660 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816622    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 13:38:51.816660 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816656    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816622    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816696    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls podName:93b6743d-2b58-4097-9f9d-ba0c15b65c85 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:52.816675697 +0000 UTC m=+38.091920218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7hgqx" (UID: "93b6743d-2b58-4097-9f9d-ba0c15b65c85") : secret "samples-operator-tls" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816712    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816721    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert podName:4e6cd64f-2485-49f1-93e5-492272ffdbac nodeName:}" failed. No retries permitted until 2026-07-20 13:38:52.816708794 +0000 UTC m=+38.091953305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-x75kq" (UID: "4e6cd64f-2485-49f1-93e5-492272ffdbac") : secret "networking-console-plugin-cert" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816724    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f8648b85-2mk59: secret "image-registry-tls" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816735    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls podName:5fac08ed-7798-439b-93f0-ca7635b58803 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:52.816728193 +0000 UTC m=+38.091972699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls") pod "dns-default-qbr68" (UID: "5fac08ed-7798-439b-93f0-ca7635b58803") : secret "dns-default-metrics-tls" not found
Jul 20 13:38:51.816863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:51.816762    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls podName:f19134bd-15a2-4e41-b5e4-a2301e4e100a nodeName:}" failed. No retries permitted until 2026-07-20 13:38:52.816751057 +0000 UTC m=+38.091995566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls") pod "image-registry-64f8648b85-2mk59" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a") : secret "image-registry-tls" not found
Jul 20 13:38:52.187218 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.187177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:38:52.187388 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.187177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:38:52.187453 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.187189    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:38:52.190912 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.190881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:38:52.191105 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.191094    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:38:52.191189 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.191099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd77k\""
Jul 20 13:38:52.191189 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.191175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpj58\""
Jul 20 13:38:52.388925 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.388887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:52.479221 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.479132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp" event={"ID":"d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176","Type":"ContainerStarted","Data":"1c9e6b83adab53bdf1c3ee9f07dfd60b21b46dc87f8557293fcfaaeacb67e5d8"}
Jul 20 13:38:52.480454 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.480397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" event={"ID":"512f33c9-f4f1-4202-9881-15a6398d5e9f","Type":"ContainerStarted","Data":"1c2de590ac088c3a17a6dda771b0ac9741c5a151833b82706c7772dc1ca6a305"}
Jul 20 13:38:52.481536 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.481491    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq" event={"ID":"536c169b-0244-4932-b303-7e06a972906f","Type":"ContainerStarted","Data":"f10ce5267e2b76ca0be9a39b7b3acb6ef8d1ba0766d65f3347c74fa875a8ef91"}
Jul 20 13:38:52.482711 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.482680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg" event={"ID":"a35db5e6-9f20-4452-bd97-518fae670e9d","Type":"ContainerStarted","Data":"f9f6a4a2e8c2cdaf6b38088b6407ac83ec879011132dbb9aed0ae3c8427fe999"}
Jul 20 13:38:52.483873 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.483849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2m52s" event={"ID":"f6989115-a0ea-4c88-ab51-b3187ec6157f","Type":"ContainerStarted","Data":"6fd22f137d1700b495127be63e6eac280c50109b6783b6ecf0b147dbd57c43e2"}
Jul 20 13:38:52.485022 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.484998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d72ts" event={"ID":"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af","Type":"ContainerStarted","Data":"9ac89a69e2d83826c4d08c81a076a43c62991b9298de5618391212a6c1a41cd5"}
Jul 20 13:38:52.486210 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.486189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr" event={"ID":"104176dc-4e6f-4a05-b180-7e2517289df2","Type":"ContainerStarted","Data":"7c1ce7affee671aca2538b8d30f9c809d9e2b38fa90c31be37e0d7890fbf6fcc"}
Jul 20 13:38:52.492907 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.492876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:52.825433 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.825347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:52.825433 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.825411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.825442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:52.825480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825505    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825521    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f8648b85-2mk59: secret "image-registry-tls" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825579    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls podName:f19134bd-15a2-4e41-b5e4-a2301e4e100a nodeName:}" failed. No retries permitted until 2026-07-20 13:38:54.825558389 +0000 UTC m=+40.100802898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls") pod "image-registry-64f8648b85-2mk59" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a") : secret "image-registry-tls" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825587    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825596    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825588    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825642    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls podName:5fac08ed-7798-439b-93f0-ca7635b58803 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:54.825625398 +0000 UTC m=+40.100869930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls") pod "dns-default-qbr68" (UID: "5fac08ed-7798-439b-93f0-ca7635b58803") : secret "dns-default-metrics-tls" not found
Jul 20 13:38:52.825650 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825661    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls podName:93b6743d-2b58-4097-9f9d-ba0c15b65c85 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:54.825653218 +0000 UTC m=+40.100897727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7hgqx" (UID: "93b6743d-2b58-4097-9f9d-ba0c15b65c85") : secret "samples-operator-tls" not found
Jul 20 13:38:52.826055 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:52.825676    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert podName:4e6cd64f-2485-49f1-93e5-492272ffdbac nodeName:}" failed. No retries permitted until 2026-07-20 13:38:54.825667589 +0000 UTC m=+40.100912100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-x75kq" (UID: "4e6cd64f-2485-49f1-93e5-492272ffdbac") : secret "networking-console-plugin-cert" not found
Jul 20 13:38:53.353115 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:53.353081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:53.413961 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:53.413922    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:54.503855 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:54.503812    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee604215-f88c-489c-9285-c937f297c47d" containerID="3ad2183f332be89dfc56129c1400fba790d95c4541f7d8d923e7d164e901a456" exitCode=0
Jul 20 13:38:54.504471 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:54.503882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerDied","Data":"3ad2183f332be89dfc56129c1400fba790d95c4541f7d8d923e7d164e901a456"}
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:54.843618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:54.843750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:54.843808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:54.843838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.843968    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844026    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls podName:5fac08ed-7798-439b-93f0-ca7635b58803 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:58.844007916 +0000 UTC m=+44.119252422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls") pod "dns-default-qbr68" (UID: "5fac08ed-7798-439b-93f0-ca7635b58803") : secret "dns-default-metrics-tls" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844452    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844503    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert podName:4e6cd64f-2485-49f1-93e5-492272ffdbac nodeName:}" failed. No retries permitted until 2026-07-20 13:38:58.844487533 +0000 UTC m=+44.119732046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-x75kq" (UID: "4e6cd64f-2485-49f1-93e5-492272ffdbac") : secret "networking-console-plugin-cert" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844576    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844586    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f8648b85-2mk59: secret "image-registry-tls" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844617    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls podName:f19134bd-15a2-4e41-b5e4-a2301e4e100a nodeName:}" failed. No retries permitted until 2026-07-20 13:38:58.84460599 +0000 UTC m=+44.119850497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls") pod "image-registry-64f8648b85-2mk59" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a") : secret "image-registry-tls" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844672    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 13:38:54.844731 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:54.844702    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls podName:93b6743d-2b58-4097-9f9d-ba0c15b65c85 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:58.844693106 +0000 UTC m=+44.119937619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7hgqx" (UID: "93b6743d-2b58-4097-9f9d-ba0c15b65c85") : secret "samples-operator-tls" not found
Jul 20 13:38:55.513822 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:55.513789    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee604215-f88c-489c-9285-c937f297c47d" containerID="862b6849ccf4505a3f08a6cc89539d062a8e82265912ced8a7d103d53a185764" exitCode=0
Jul 20 13:38:55.514232 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:55.513846    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerDied","Data":"862b6849ccf4505a3f08a6cc89539d062a8e82265912ced8a7d103d53a185764"}
Jul 20 13:38:56.798606 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:56.798548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:56.897970 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:56.897927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:58.885346 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:58.885309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:58.885371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:58.885402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:38:58.885442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885461    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885487    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f8648b85-2mk59: secret "image-registry-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885488    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885523    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885541    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls podName:f19134bd-15a2-4e41-b5e4-a2301e4e100a nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.885522024 +0000 UTC m=+52.160766531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls") pod "image-registry-64f8648b85-2mk59" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a") : secret "image-registry-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885557    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls podName:93b6743d-2b58-4097-9f9d-ba0c15b65c85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.885549385 +0000 UTC m=+52.160793892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7hgqx" (UID: "93b6743d-2b58-4097-9f9d-ba0c15b65c85") : secret "samples-operator-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885569    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls podName:5fac08ed-7798-439b-93f0-ca7635b58803 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.885563544 +0000 UTC m=+52.160808050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls") pod "dns-default-qbr68" (UID: "5fac08ed-7798-439b-93f0-ca7635b58803") : secret "dns-default-metrics-tls" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885571    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 13:38:58.885774 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:38:58.885629    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert podName:4e6cd64f-2485-49f1-93e5-492272ffdbac nodeName:}" failed. No retries permitted until 2026-07-20 13:39:06.885610933 +0000 UTC m=+52.160855634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-x75kq" (UID: "4e6cd64f-2485-49f1-93e5-492272ffdbac") : secret "networking-console-plugin-cert" not found
Jul 20 13:39:00.392720 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:00.392678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:01.534504 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.534404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp" event={"ID":"d9b76297-e3b9-4aea-9dbd-fd6a7ccbf176","Type":"ContainerStarted","Data":"e8c371e8d2b39f56879a9dc339d835057d158338e56b6f0173263e7659a022a1"}
Jul 20 13:39:01.536292 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.536269    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/0.log"
Jul 20 13:39:01.536422 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.536311    2559 generic.go:356] "Generic (PLEG): container finished" podID="512f33c9-f4f1-4202-9881-15a6398d5e9f" containerID="dec23cb621f1d1b9a250e75aee5284a654c29749aacdb9f508f1808265f92027" exitCode=255
Jul 20 13:39:01.536422 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.536390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" event={"ID":"512f33c9-f4f1-4202-9881-15a6398d5e9f","Type":"ContainerDied","Data":"dec23cb621f1d1b9a250e75aee5284a654c29749aacdb9f508f1808265f92027"}
Jul 20 13:39:01.536644 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.536622    2559 scope.go:117] "RemoveContainer" containerID="dec23cb621f1d1b9a250e75aee5284a654c29749aacdb9f508f1808265f92027"
Jul 20 13:39:01.538944 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.538676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq" event={"ID":"536c169b-0244-4932-b303-7e06a972906f","Type":"ContainerStarted","Data":"9fadbef5ebe16428c285df00079f88a6121a24beccbe65a6e087811b0cbb1749"}
Jul 20 13:39:01.541318 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.541290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg" event={"ID":"a35db5e6-9f20-4452-bd97-518fae670e9d","Type":"ContainerStarted","Data":"9bd796141121926f1c4ba2505bfa2db0c538950e56d965ca45bd50a1e470cd01"}
Jul 20 13:39:01.543363 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.543310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2m52s" event={"ID":"f6989115-a0ea-4c88-ab51-b3187ec6157f","Type":"ContainerStarted","Data":"39dc19b949f9fb016a5af1ff32dfb50a23dece906651c2d9d0d9945bbecfe9d8"}
Jul 20 13:39:01.545314 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.545260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d72ts" event={"ID":"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af","Type":"ContainerStarted","Data":"b093a653477c68a38d392624e99ee397552daea5b9e740371fb807c00fb7d1e8"}
Jul 20 13:39:01.549203 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.549075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" event={"ID":"ee604215-f88c-489c-9285-c937f297c47d","Type":"ContainerStarted","Data":"054c0d612aec53bf488513b3b5be5922487be6fe2a91a0900e99c03523292730"}
Jul 20 13:39:01.550407 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.550151    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pdzvp" podStartSLOduration=29.12163657 podStartE2EDuration="38.550139763s" totalImagesPullingTime="9.428503193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.549822021 +0000 UTC m=+46.825066641" watchObservedRunningTime="2026-07-20 13:39:01.550139763 +0000 UTC m=+46.825384292"
Jul 20 13:39:01.551826 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.551805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr" event={"ID":"104176dc-4e6f-4a05-b180-7e2517289df2","Type":"ContainerStarted","Data":"b84495ac262db4ded343c98f58946f3a4dc9a6101a659a8851f7532e5443de0f"}
Jul 20 13:39:01.569068 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.569015    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-d72ts" podStartSLOduration=36.074483222 podStartE2EDuration="45.568994995s" totalImagesPullingTime="9.494511773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.568488048 +0000 UTC m=+46.843732578" watchObservedRunningTime="2026-07-20 13:39:01.568994995 +0000 UTC m=+46.844239525"
Jul 20 13:39:01.590838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.590768    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s8v5d" podStartSLOduration=13.613948458 podStartE2EDuration="45.59074576s" totalImagesPullingTime="31.976797302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.589127105 +0000 UTC m=+46.864371636" watchObservedRunningTime="2026-07-20 13:39:01.59074576 +0000 UTC m=+46.865990293"
Jul 20 13:39:01.604259 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.604197    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq" podStartSLOduration=35.121493294 podStartE2EDuration="44.604146433s" totalImagesPullingTime="9.482653139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.603620785 +0000 UTC m=+46.878865314" watchObservedRunningTime="2026-07-20 13:39:01.604146433 +0000 UTC m=+46.879390963"
Jul 20 13:39:01.646685 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.646625    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qpnzg" podStartSLOduration=35.170255305 podStartE2EDuration="44.646604048s" totalImagesPullingTime="9.476348743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.627891559 +0000 UTC m=+46.903136088" watchObservedRunningTime="2026-07-20 13:39:01.646604048 +0000 UTC m=+46.921848580"
Jul 20 13:39:01.663529 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.662972    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2m52s" podStartSLOduration=1.217343595 podStartE2EDuration="10.662952374s" totalImagesPullingTime="9.445608779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.662326538 +0000 UTC m=+46.937571068" watchObservedRunningTime="2026-07-20 13:39:01.662952374 +0000 UTC m=+46.938196907"
Jul 20 13:39:01.732271 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.732224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:01.811748 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:01.811658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:02.493953 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.493910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:02.552711 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.552675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:02.556998 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.556963    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:39:02.557664 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.557643    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/0.log"
Jul 20 13:39:02.557850 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.557829    2559 generic.go:356] "Generic (PLEG): container finished" podID="512f33c9-f4f1-4202-9881-15a6398d5e9f" containerID="26e93e447ccfbdfda8332dac5194d43466f3d1ffb68893296b5da42afea704bb" exitCode=255
Jul 20 13:39:02.558302 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.558284    2559 scope.go:117] "RemoveContainer" containerID="26e93e447ccfbdfda8332dac5194d43466f3d1ffb68893296b5da42afea704bb"
Jul 20 13:39:02.558902 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:02.558860    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfcx6_openshift-console-operator(512f33c9-f4f1-4202-9881-15a6398d5e9f)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" podUID="512f33c9-f4f1-4202-9881-15a6398d5e9f"
Jul 20 13:39:02.559013 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.558989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" event={"ID":"512f33c9-f4f1-4202-9881-15a6398d5e9f","Type":"ContainerDied","Data":"26e93e447ccfbdfda8332dac5194d43466f3d1ffb68893296b5da42afea704bb"}
Jul 20 13:39:02.571449 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.571391    2559 scope.go:117] "RemoveContainer" containerID="dec23cb621f1d1b9a250e75aee5284a654c29749aacdb9f508f1808265f92027"
Jul 20 13:39:02.575871 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.575828    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr" podStartSLOduration=36.111294338 podStartE2EDuration="45.575811723s" totalImagesPullingTime="9.464517385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:01.682205316 +0000 UTC m=+46.957449849" watchObservedRunningTime="2026-07-20 13:39:02.575811723 +0000 UTC m=+47.851056447"
Jul 20 13:39:02.765828 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.765732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:02.847252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.847216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:02.972024 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:02.971962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.069572 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.069483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.227897 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.227863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.326574 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.326486    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.405506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.405462    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lnck5"]
Jul 20 13:39:03.448175 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.448132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.450452 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.450430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lnck5"]
Jul 20 13:39:03.450592 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.450537    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.453504 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.453481    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 13:39:03.453629 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.453507    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xqm2v\""
Jul 20 13:39:03.453629 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.453521    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 13:39:03.530497 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.530465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.564895 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.564873    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:39:03.565298 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.565224    2559 scope.go:117] "RemoveContainer" containerID="26e93e447ccfbdfda8332dac5194d43466f3d1ffb68893296b5da42afea704bb"
Jul 20 13:39:03.565390 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:03.565371    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfcx6_openshift-console-operator(512f33c9-f4f1-4202-9881-15a6398d5e9f)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" podUID="512f33c9-f4f1-4202-9881-15a6398d5e9f"
Jul 20 13:39:03.643929 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.643844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plxm2\" (UniqueName: \"kubernetes.io/projected/53508da8-0550-456a-a672-fec202952a85-kube-api-access-plxm2\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.643929 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.643893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.643929 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.643918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.644199 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.644050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53508da8-0550-456a-a672-fec202952a85-data-volume\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.644199 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.644103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53508da8-0550-456a-a672-fec202952a85-crio-socket\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.744984 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.744948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53508da8-0550-456a-a672-fec202952a85-data-volume\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.745201 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.744992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53508da8-0550-456a-a672-fec202952a85-crio-socket\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.745201 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.745043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxm2\" (UniqueName: \"kubernetes.io/projected/53508da8-0550-456a-a672-fec202952a85-kube-api-access-plxm2\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.745201 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.745062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.745201 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.745082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.745413 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:03.745205    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:03.745413 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:03.745231    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:03.745413 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:03.745268    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:04.245253964 +0000 UTC m=+49.520498485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:03.745413 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:03.745286    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:04.245273455 +0000 UTC m=+49.520517967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:03.745413 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.745228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53508da8-0550-456a-a672-fec202952a85-crio-socket\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.745413 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.745374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53508da8-0550-456a-a672-fec202952a85-data-volume\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.760754 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.760719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plxm2\" (UniqueName: \"kubernetes.io/projected/53508da8-0550-456a-a672-fec202952a85-kube-api-access-plxm2\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:03.774316 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.774291    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"]
Jul 20 13:39:03.789134 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.789106    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"]
Jul 20 13:39:03.789330 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.789240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"
Jul 20 13:39:03.791849 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.791823    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zm8zc\""
Jul 20 13:39:03.791987 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.791823    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 13:39:03.791987 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.791904    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 13:39:03.820351 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.820320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.845552 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.845523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzdw4\" (UniqueName: \"kubernetes.io/projected/c00aa2ee-9db5-4fed-a02e-88e5f2b10092-kube-api-access-gzdw4\") pod \"migrator-7cc9c7ffd7-5rm2t\" (UID: \"c00aa2ee-9db5-4fed-a02e-88e5f2b10092\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"
Jul 20 13:39:03.891532 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.891496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:03.946538 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.946500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzdw4\" (UniqueName: \"kubernetes.io/projected/c00aa2ee-9db5-4fed-a02e-88e5f2b10092-kube-api-access-gzdw4\") pod \"migrator-7cc9c7ffd7-5rm2t\" (UID: \"c00aa2ee-9db5-4fed-a02e-88e5f2b10092\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"
Jul 20 13:39:03.955066 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:03.955028    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzdw4\" (UniqueName: \"kubernetes.io/projected/c00aa2ee-9db5-4fed-a02e-88e5f2b10092-kube-api-access-gzdw4\") pod \"migrator-7cc9c7ffd7-5rm2t\" (UID: \"c00aa2ee-9db5-4fed-a02e-88e5f2b10092\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"
Jul 20 13:39:04.099246 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.099134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"
Jul 20 13:39:04.249535 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.249439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:04.249535 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.249488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:04.249772 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:04.249567    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:04.249772 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:04.249653    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:05.249631747 +0000 UTC m=+50.524876269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:04.249772 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:04.249680    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:04.249890 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:04.249772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:05.249752174 +0000 UTC m=+50.524996696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:04.250606 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.250584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t"]
Jul 20 13:39:04.253644 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:04.253620    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00aa2ee_9db5_4fed_a02e_88e5f2b10092.slice/crio-7535046f90b6605342581e32e34ae27bcc240b4c5eecdae4a103b386a6fba458 WatchSource:0}: Error finding container 7535046f90b6605342581e32e34ae27bcc240b4c5eecdae4a103b386a6fba458: Status 404 returned error can't find the container with id 7535046f90b6605342581e32e34ae27bcc240b4c5eecdae4a103b386a6fba458
Jul 20 13:39:04.568651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.568574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t" event={"ID":"c00aa2ee-9db5-4fed-a02e-88e5f2b10092","Type":"ContainerStarted","Data":"7535046f90b6605342581e32e34ae27bcc240b4c5eecdae4a103b386a6fba458"}
Jul 20 13:39:04.606644 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.606610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:04.712329 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.712298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:04.888592 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.888516    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tgj6m_7a431a02-a3be-4869-9b22-5a62f3308d91/dns-node-resolver/0.log"
Jul 20 13:39:04.889908 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.889881    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:04.992730 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:04.992699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:05.256494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:05.256460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:05.256494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:05.256502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:05.256758 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:05.256618    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:05.256758 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:05.256649    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:05.256758 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:05.256673    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:07.256658126 +0000 UTC m=+52.531902635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:05.256758 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:05.256725    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:07.25670562 +0000 UTC m=+52.531950126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:05.684712 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:05.684682    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx6gq_a5065019-e701-4274-8316-988546bdeffa/node-ca/0.log"
Jul 20 13:39:05.907123 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:05.907084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:06.087993 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.087962    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m52s_f6989115-a0ea-4c88-ab51-b3187ec6157f/serve-healthcheck-canary/0.log"
Jul 20 13:39:06.577446 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.577406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t" event={"ID":"c00aa2ee-9db5-4fed-a02e-88e5f2b10092","Type":"ContainerStarted","Data":"552ccbff6e72cb3539e7b75c5c9fc1ccee9718a6599236b8bbdd6adae0d18670"}
Jul 20 13:39:06.577621 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.577465    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t" event={"ID":"c00aa2ee-9db5-4fed-a02e-88e5f2b10092","Type":"ContainerStarted","Data":"72655c6c71b906220bbfd5f6d38c29b6cad489565cf62a30ecf0e7af1a97ca46"}
Jul 20 13:39:06.594565 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.594514    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5rm2t" podStartSLOduration=1.9066124850000001 podStartE2EDuration="3.594495085s" totalImagesPullingTime="1.6878826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:06.593552149 +0000 UTC m=+51.868796679" watchObservedRunningTime="2026-07-20 13:39:06.594495085 +0000 UTC m=+51.869739669"
Jul 20 13:39:06.971764 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.971723    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.971778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.971808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:06.971842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971892    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971896    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971910    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64f8648b85-2mk59: secret "image-registry-tls" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971942    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971968    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls podName:93b6743d-2b58-4097-9f9d-ba0c15b65c85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:22.971951581 +0000 UTC m=+68.247196091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-7hgqx" (UID: "93b6743d-2b58-4097-9f9d-ba0c15b65c85") : secret "samples-operator-tls" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971977    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.971983    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls podName:f19134bd-15a2-4e41-b5e4-a2301e4e100a nodeName:}" failed. No retries permitted until 2026-07-20 13:39:22.971977092 +0000 UTC m=+68.247221598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls") pod "image-registry-64f8648b85-2mk59" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a") : secret "image-registry-tls" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.972000    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert podName:4e6cd64f-2485-49f1-93e5-492272ffdbac nodeName:}" failed. No retries permitted until 2026-07-20 13:39:22.971994519 +0000 UTC m=+68.247239025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-x75kq" (UID: "4e6cd64f-2485-49f1-93e5-492272ffdbac") : secret "networking-console-plugin-cert" not found
Jul 20 13:39:06.972241 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:06.972033    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls podName:5fac08ed-7798-439b-93f0-ca7635b58803 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:22.972013325 +0000 UTC m=+68.247257838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls") pod "dns-default-qbr68" (UID: "5fac08ed-7798-439b-93f0-ca7635b58803") : secret "dns-default-metrics-tls" not found
Jul 20 13:39:07.274496 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:07.274406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:07.274496 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:07.274455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:07.274784 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:07.274551    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:07.274784 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:07.274596    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:39:07.274784 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:07.274622    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:11.274604761 +0000 UTC m=+56.549849270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:07.274784 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:07.274645    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:11.274633472 +0000 UTC m=+56.549877982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : configmap "kube-rbac-proxy" not found
Jul 20 13:39:11.308957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:11.308918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:11.308957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:11.308957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:11.309405 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:11.309058    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:11.309405 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:11.309124    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls podName:53508da8-0550-456a-a672-fec202952a85 nodeName:}" failed. No retries permitted until 2026-07-20 13:39:19.309109389 +0000 UTC m=+64.584353896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lnck5" (UID: "53508da8-0550-456a-a672-fec202952a85") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:39:11.309553 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:11.309533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53508da8-0550-456a-a672-fec202952a85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:11.436107 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:11.436045    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:39:11.436279 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:11.436134    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:39:11.436539 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:11.436525    2559 scope.go:117] "RemoveContainer" containerID="26e93e447ccfbdfda8332dac5194d43466f3d1ffb68893296b5da42afea704bb"
Jul 20 13:39:11.436699 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:39:11.436680    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-lfcx6_openshift-console-operator(512f33c9-f4f1-4202-9881-15a6398d5e9f)\"" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" podUID="512f33c9-f4f1-4202-9881-15a6398d5e9f"
Jul 20 13:39:18.476219 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:18.476192    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xv9hj"
Jul 20 13:39:19.378404 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:19.378360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:19.380823 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:19.380791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53508da8-0550-456a-a672-fec202952a85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lnck5\" (UID: \"53508da8-0550-456a-a672-fec202952a85\") " pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:19.662899 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:19.662872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xqm2v\""
Jul 20 13:39:19.671002 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:19.670975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lnck5"
Jul 20 13:39:19.806575 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:19.806543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lnck5"]
Jul 20 13:39:19.810002 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:19.809972    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53508da8_0550_456a_a672_fec202952a85.slice/crio-a22d7b35e56772eb9b72b19016a92673012b6e6a84f189b4bb1f737016f99d20 WatchSource:0}: Error finding container a22d7b35e56772eb9b72b19016a92673012b6e6a84f189b4bb1f737016f99d20: Status 404 returned error can't find the container with id a22d7b35e56772eb9b72b19016a92673012b6e6a84f189b4bb1f737016f99d20
Jul 20 13:39:20.626495 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.626452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lnck5" event={"ID":"53508da8-0550-456a-a672-fec202952a85","Type":"ContainerStarted","Data":"a22d7b35e56772eb9b72b19016a92673012b6e6a84f189b4bb1f737016f99d20"}
Jul 20 13:39:20.892651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.891822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:39:20.892651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.891893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:39:20.892651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.891968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:39:20.895126 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.895100    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:39:20.895392 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.895372    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:39:20.895671 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.895646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgmh\" (UniqueName: \"kubernetes.io/projected/bb2d0adf-bcdb-4c71-8caa-9db18fea84ff-kube-api-access-pcgmh\") pod \"network-check-target-7j7rl\" (UID: \"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff\") " pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:39:20.905276 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.905204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b5f069d-82bd-4c58-8fef-b54c87b9f6a0-original-pull-secret\") pod \"global-pull-secret-syncer-5ppt7\" (UID: \"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0\") " pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:39:20.905417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:20.905348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1-metrics-certs\") pod \"network-metrics-daemon-h5q5q\" (UID: \"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1\") " pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:39:21.002400 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.002366    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpj58\""
Jul 20 13:39:21.009552 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.009522    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd77k\""
Jul 20 13:39:21.010510 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.010485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:39:21.013491 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.013469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ppt7"
Jul 20 13:39:21.018522 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.018354    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5q5q"
Jul 20 13:39:21.181392 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.181317    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ppt7"]
Jul 20 13:39:21.209290 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.208313    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7j7rl"]
Jul 20 13:39:21.211517 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.211490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5q5q"]
Jul 20 13:39:21.214659 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:21.214629    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2d0adf_bcdb_4c71_8caa_9db18fea84ff.slice/crio-ee57c655af84524aace102359bf3c782d92d39d33db6d86487ec4a68ec76c549 WatchSource:0}: Error finding container ee57c655af84524aace102359bf3c782d92d39d33db6d86487ec4a68ec76c549: Status 404 returned error can't find the container with id ee57c655af84524aace102359bf3c782d92d39d33db6d86487ec4a68ec76c549
Jul 20 13:39:21.215566 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:21.215542    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ce1fe9_7c1a_4c18_bc24_4ccda6e85eb1.slice/crio-66c603c69a6096591ecb3a2037941ae56b4aea5a1e833f4db2e77281b968540b WatchSource:0}: Error finding container 66c603c69a6096591ecb3a2037941ae56b4aea5a1e833f4db2e77281b968540b: Status 404 returned error can't find the container with id 66c603c69a6096591ecb3a2037941ae56b4aea5a1e833f4db2e77281b968540b
Jul 20 13:39:21.632402 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.632360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7j7rl" event={"ID":"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff","Type":"ContainerStarted","Data":"dcb298bd338068f0acc42ab326e22976714934bed57236f113a68de21152f671"}
Jul 20 13:39:21.632581 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.632458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7j7rl" event={"ID":"bb2d0adf-bcdb-4c71-8caa-9db18fea84ff","Type":"ContainerStarted","Data":"ee57c655af84524aace102359bf3c782d92d39d33db6d86487ec4a68ec76c549"}
Jul 20 13:39:21.632581 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.632486    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:39:21.633689 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.633661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5q5q" event={"ID":"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1","Type":"ContainerStarted","Data":"66c603c69a6096591ecb3a2037941ae56b4aea5a1e833f4db2e77281b968540b"}
Jul 20 13:39:21.634867 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.634838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ppt7" event={"ID":"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0","Type":"ContainerStarted","Data":"38845302969a8a1eabb9fb5bba35634cd222f7d5af073a898aa645895ac2a2be"}
Jul 20 13:39:21.650821 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:21.650763    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7j7rl" podStartSLOduration=65.650744439 podStartE2EDuration="1m5.650744439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:21.649868321 +0000 UTC m=+66.925112851" watchObservedRunningTime="2026-07-20 13:39:21.650744439 +0000 UTC m=+66.925988970"
Jul 20 13:39:23.016307 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.016262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:39:23.016689 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.016383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:39:23.016689 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.016432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:39:23.016689 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.016464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:39:23.019424 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.019356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fac08ed-7798-439b-93f0-ca7635b58803-metrics-tls\") pod \"dns-default-qbr68\" (UID: \"5fac08ed-7798-439b-93f0-ca7635b58803\") " pod="openshift-dns/dns-default-qbr68"
Jul 20 13:39:23.019907 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.019862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93b6743d-2b58-4097-9f9d-ba0c15b65c85-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-7hgqx\" (UID: \"93b6743d-2b58-4097-9f9d-ba0c15b65c85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:39:23.020494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.020452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd64f-2485-49f1-93e5-492272ffdbac-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-x75kq\" (UID: \"4e6cd64f-2485-49f1-93e5-492272ffdbac\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:39:23.020588 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.020552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"image-registry-64f8648b85-2mk59\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") " pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:39:23.169113 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.169079    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-stk7v\""
Jul 20 13:39:23.176306 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.176278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"
Jul 20 13:39:23.187110 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.187078    2559 scope.go:117] "RemoveContainer" containerID="26e93e447ccfbdfda8332dac5194d43466f3d1ffb68893296b5da42afea704bb"
Jul 20 13:39:23.198720 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.198692    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d6whh\""
Jul 20 13:39:23.206062 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.206034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:39:23.245220 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.245191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbmz6\""
Jul 20 13:39:23.251633 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.251606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8jsgq\""
Jul 20 13:39:23.253292 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.253262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbr68"
Jul 20 13:39:23.259720 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:23.259696    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"
Jul 20 13:39:27.311409 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.311307    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qbr68"]
Jul 20 13:39:27.367839 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.367779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f8648b85-2mk59"]
Jul 20 13:39:27.376463 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.376241    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq"]
Jul 20 13:39:27.377031 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:27.376994    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19134bd_15a2_4e41_b5e4_a2301e4e100a.slice/crio-2e6c6f4628462e0789e65b8a7c8ac7ce735cdf014d58755927b54c01e747b5a3 WatchSource:0}: Error finding container 2e6c6f4628462e0789e65b8a7c8ac7ce735cdf014d58755927b54c01e747b5a3: Status 404 returned error can't find the container with id 2e6c6f4628462e0789e65b8a7c8ac7ce735cdf014d58755927b54c01e747b5a3
Jul 20 13:39:27.381265 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:27.381235    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6cd64f_2485_49f1_93e5_492272ffdbac.slice/crio-8e0f43b84d08baf72ceef538d435015f98289f2e5c7afb5057380938ab221f08 WatchSource:0}: Error finding container 8e0f43b84d08baf72ceef538d435015f98289f2e5c7afb5057380938ab221f08: Status 404 returned error can't find the container with id 8e0f43b84d08baf72ceef538d435015f98289f2e5c7afb5057380938ab221f08
Jul 20 13:39:27.391554 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.391527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx"]
Jul 20 13:39:27.666051 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.666008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx" event={"ID":"93b6743d-2b58-4097-9f9d-ba0c15b65c85","Type":"ContainerStarted","Data":"b581908c261df28924e2761b1f15c1c6c9d7e0f43c5c8d2ff403ee71770291c5"}
Jul 20 13:39:27.667980 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.667960    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:39:27.668113 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.668045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" event={"ID":"512f33c9-f4f1-4202-9881-15a6398d5e9f","Type":"ContainerStarted","Data":"0d9f7fa6e4c352f5089a392f196ace2ed80e3d8ba43b1f8fa5cb6cd4352235f3"}
Jul 20 13:39:27.668398 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.668376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:39:27.669816 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.669789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lnck5" event={"ID":"53508da8-0550-456a-a672-fec202952a85","Type":"ContainerStarted","Data":"69a32c91d6e650cd4b84b58d8c886c68e461bdd7e8aa677ae5685c7cf734d07d"}
Jul 20 13:39:27.672106 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.672077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5q5q" event={"ID":"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1","Type":"ContainerStarted","Data":"b3729fe6ed4cafd5788ff1650329d8cbab531a8b5119258745f4829b8a6da3d3"}
Jul 20 13:39:27.672235 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.672119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5q5q" event={"ID":"79ce1fe9-7c1a-4c18-bc24-4ccda6e85eb1","Type":"ContainerStarted","Data":"ecd4ede06c9582a1c0709a335ce51286f21a7a0e879f03c708c60c4e1b82a3fe"}
Jul 20 13:39:27.673689 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.673656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ppt7" event={"ID":"2b5f069d-82bd-4c58-8fef-b54c87b9f6a0","Type":"ContainerStarted","Data":"4dd730277861958832935c945987c73ebad7318a369f2986a216f6683a042851"}
Jul 20 13:39:27.674891 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.674869    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbr68" event={"ID":"5fac08ed-7798-439b-93f0-ca7635b58803","Type":"ContainerStarted","Data":"3f90f81f9a60c6f55a75f9a413fc7bd0f6cf505025dc1efa3dea249fecf85038"}
Jul 20 13:39:27.676810 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.676510    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f8648b85-2mk59" event={"ID":"f19134bd-15a2-4e41-b5e4-a2301e4e100a","Type":"ContainerStarted","Data":"39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9"}
Jul 20 13:39:27.676810 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.676547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f8648b85-2mk59" event={"ID":"f19134bd-15a2-4e41-b5e4-a2301e4e100a","Type":"ContainerStarted","Data":"2e6c6f4628462e0789e65b8a7c8ac7ce735cdf014d58755927b54c01e747b5a3"}
Jul 20 13:39:27.676810 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.676614    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:39:27.677869 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.677849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq" event={"ID":"4e6cd64f-2485-49f1-93e5-492272ffdbac","Type":"ContainerStarted","Data":"8e0f43b84d08baf72ceef538d435015f98289f2e5c7afb5057380938ab221f08"}
Jul 20 13:39:27.714819 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.714757    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6" podStartSLOduration=61.267598835 podStartE2EDuration="1m10.714735782s" totalImagesPullingTime="9.447136947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:27.689247151 +0000 UTC m=+72.964491679" watchObservedRunningTime="2026-07-20 13:39:27.714735782 +0000 UTC m=+72.989980312"
Jul 20 13:39:27.733353 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.733298    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h5q5q" podStartSLOduration=70.573651947 podStartE2EDuration="1m11.733266297s" totalImagesPullingTime="1.15961435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:27.732381743 +0000 UTC m=+73.007626274" watchObservedRunningTime="2026-07-20 13:39:27.733266297 +0000 UTC m=+73.008510825"
Jul 20 13:39:27.733553 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.733396    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64f8648b85-2mk59" podStartSLOduration=71.733386122 podStartE2EDuration="1m11.733386122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:27.715743848 +0000 UTC m=+72.990988379" watchObservedRunningTime="2026-07-20 13:39:27.733386122 +0000 UTC m=+73.008630654"
Jul 20 13:39:27.753491 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.753404    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5ppt7" podStartSLOduration=65.88152685 podStartE2EDuration="1m11.753381192s" totalImagesPullingTime="5.871854342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:27.753332473 +0000 UTC m=+73.028577003" watchObservedRunningTime="2026-07-20 13:39:27.753381192 +0000 UTC m=+73.028625722"
Jul 20 13:39:27.915334 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.914297    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"]
Jul 20 13:39:27.919733 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.919303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:27.922386 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.922196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 20 13:39:27.922872 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.922680    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 13:39:27.922872 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.922709    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 13:39:27.923013 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.922970    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 20 13:39:27.923312 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.923148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 20 13:39:27.923550 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.923528    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 13:39:27.923639 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.923534    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 20 13:39:27.941583 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.941554    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"]
Jul 20 13:39:27.985536 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:27.985296    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-lfcx6"
Jul 20 13:39:28.070508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.070396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.070508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.070446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.070508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.070474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-ca\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.070835 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.070588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.070835 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.070742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-hub\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.070835 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.070803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nckk5\" (UniqueName: \"kubernetes.io/projected/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-kube-api-access-nckk5\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.175767 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.175589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.176227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.175968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-hub\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.176227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.176020    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nckk5\" (UniqueName: \"kubernetes.io/projected/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-kube-api-access-nckk5\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.176227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.176070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.176227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.176103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.176227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.176130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-ca\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.179467 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.179054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.185177 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.184631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-ca\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.185898 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.185870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-hub\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.189515 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.189486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.191233 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.191154    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.201369 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.201334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nckk5\" (UniqueName: \"kubernetes.io/projected/72eb7cbc-9a72-4d38-a48c-b774fb927ce0-kube-api-access-nckk5\") pod \"cluster-proxy-proxy-agent-64db84cd77-jdk9w\" (UID: \"72eb7cbc-9a72-4d38-a48c-b774fb927ce0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.242582 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.242395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"
Jul 20 13:39:28.505351 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.505217    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w"]
Jul 20 13:39:28.510048 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:28.510002    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72eb7cbc_9a72_4d38_a48c_b774fb927ce0.slice/crio-53643a1cdd9a697adc584ae0e6f540f81b2f2ce0b69a970f65f1c4400c5f7346 WatchSource:0}: Error finding container 53643a1cdd9a697adc584ae0e6f540f81b2f2ce0b69a970f65f1c4400c5f7346: Status 404 returned error can't find the container with id 53643a1cdd9a697adc584ae0e6f540f81b2f2ce0b69a970f65f1c4400c5f7346
Jul 20 13:39:28.686233 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:28.686200    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w" event={"ID":"72eb7cbc-9a72-4d38-a48c-b774fb927ce0","Type":"ContainerStarted","Data":"53643a1cdd9a697adc584ae0e6f540f81b2f2ce0b69a970f65f1c4400c5f7346"}
Jul 20 13:39:35.714742 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:35.714700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lnck5" event={"ID":"53508da8-0550-456a-a672-fec202952a85","Type":"ContainerStarted","Data":"4811a0af56be4719ebc33dfa3c96d8deede692438c7a52442ddcc552bd1afe3d"}
Jul 20 13:39:35.718010 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:35.717509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w" event={"ID":"72eb7cbc-9a72-4d38-a48c-b774fb927ce0","Type":"ContainerStarted","Data":"3eb89a5736adc5eb9666a0e11b3d0ac46ca30caa570e849591cc0f764b09f616"}
Jul 20 13:39:35.719609 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:35.719426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbr68" event={"ID":"5fac08ed-7798-439b-93f0-ca7635b58803","Type":"ContainerStarted","Data":"cc6ae76b7da0a8bf3c2b466ba85470720f39069a24391f5d24d7124cd1f5ce4d"}
Jul 20 13:39:35.721077 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:35.720994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq" event={"ID":"4e6cd64f-2485-49f1-93e5-492272ffdbac","Type":"ContainerStarted","Data":"783afb5adb8f0cb1e3da004fd7140b64da9e72778347fe554b7ac43a0df3ef6c"}
Jul 20 13:39:35.723080 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:35.723019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx" event={"ID":"93b6743d-2b58-4097-9f9d-ba0c15b65c85","Type":"ContainerStarted","Data":"f5efbd3f7cc845c3a8ef1e9dca67e109d3164edadd0a82b2abc288aaf3e1bcef"}
Jul 20 13:39:35.752993 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:35.752943    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-x75kq" podStartSLOduration=39.218815648 podStartE2EDuration="46.752789996s" totalImagesPullingTime="7.533974348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:35.752307922 +0000 UTC m=+81.027552451" watchObservedRunningTime="2026-07-20 13:39:35.752789996 +0000 UTC m=+81.028034526"
Jul 20 13:39:36.730677 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.730514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx" event={"ID":"93b6743d-2b58-4097-9f9d-ba0c15b65c85","Type":"ContainerStarted","Data":"b3e9cdc1d7ee6d0a2ea4a99d3368f0e37b87bbaa2f599ab2ec386f806ca8c1dd"}
Jul 20 13:39:36.732977 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.732948    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w" event={"ID":"72eb7cbc-9a72-4d38-a48c-b774fb927ce0","Type":"ContainerStarted","Data":"13ac6bf37cc37acbc81c3ab91e024a078b1d87c6d299493c48d2714257b30e8c"}
Jul 20 13:39:36.733093 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.732989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w" event={"ID":"72eb7cbc-9a72-4d38-a48c-b774fb927ce0","Type":"ContainerStarted","Data":"f7afa7caeb5237f09e000521a642f1f6c5e58bb82c0f418a6729fc8de4bc3c99"}
Jul 20 13:39:36.735275 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.735199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbr68" event={"ID":"5fac08ed-7798-439b-93f0-ca7635b58803","Type":"ContainerStarted","Data":"5804aeb7cfe5020a450fbe25d3c08b78ac248a0b8d44f1f6b10c07daf14fe241"}
Jul 20 13:39:36.748110 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.747864    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-7hgqx" podStartSLOduration=73.089579196 podStartE2EDuration="1m20.747847383s" totalImagesPullingTime="7.658268187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:36.746265836 +0000 UTC m=+82.021510357" watchObservedRunningTime="2026-07-20 13:39:36.747847383 +0000 UTC m=+82.023091911"
Jul 20 13:39:36.765554 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.765500    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64db84cd77-jdk9w" podStartSLOduration=2.710604459 podStartE2EDuration="9.765478601s" totalImagesPullingTime="7.054874142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:36.763758572 +0000 UTC m=+82.039003111" watchObservedRunningTime="2026-07-20 13:39:36.765478601 +0000 UTC m=+82.040723126"
Jul 20 13:39:36.781384 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:36.781327    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qbr68" podStartSLOduration=38.023095443 podStartE2EDuration="45.781306656s" totalImagesPullingTime="7.758211213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:36.780422339 +0000 UTC m=+82.055666870" watchObservedRunningTime="2026-07-20 13:39:36.781306656 +0000 UTC m=+82.056551165"
Jul 20 13:39:37.740615 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:37.740582    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qbr68"
Jul 20 13:39:39.751962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:39.751914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lnck5" event={"ID":"53508da8-0550-456a-a672-fec202952a85","Type":"ContainerStarted","Data":"3c7556c929e1ea6613d992b0a94a8d52f4cd5d62200e284d6124901a128f400e"}
Jul 20 13:39:39.770605 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:39.770548    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lnck5" podStartSLOduration=17.612933603 podStartE2EDuration="36.77053071s" totalImagesPullingTime="19.157597107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:39:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:39.769438329 +0000 UTC m=+85.044682858" watchObservedRunningTime="2026-07-20 13:39:39.77053071 +0000 UTC m=+85.045775236"
Jul 20 13:39:47.748950 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:47.748920    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qbr68"
Jul 20 13:39:48.693133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:48.693102    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:39:49.444698 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.444661    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s5tv5"]
Jul 20 13:39:49.449046 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.449029    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.464629 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.464604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 13:39:49.464757 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.464683    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 13:39:49.465546 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.465533    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 13:39:49.465670 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.465653    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 13:39:49.465778 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.465668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q6f2h\""
Jul 20 13:39:49.465778 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.465672    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 13:39:49.465778 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.465703    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 13:39:49.548906 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.548875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.548906 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.548917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.548997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-root\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.549044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-wtmp\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.549062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lrh\" (UniqueName: \"kubernetes.io/projected/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-kube-api-access-k7lrh\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.549082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-textfile\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549133 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.549123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-tls\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549314 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.549149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-metrics-client-ca\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.549314 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.549229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-sys\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.649927 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.649889    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-root\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.649927 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.649926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-wtmp\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.649953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lrh\" (UniqueName: \"kubernetes.io/projected/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-kube-api-access-k7lrh\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.649982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-textfile\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-tls\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-metrics-client-ca\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-sys\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-root\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-wtmp\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-sys\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-textfile\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650804 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.650850 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.650781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-metrics-client-ca\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.652617 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.652597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.652716 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.652699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-node-exporter-tls\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.670335 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.670308    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lrh\" (UniqueName: \"kubernetes.io/projected/e1b952a9-014a-4fb2-ba7c-ad22636a23e3-kube-api-access-k7lrh\") pod \"node-exporter-s5tv5\" (UID: \"e1b952a9-014a-4fb2-ba7c-ad22636a23e3\") " pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.757463 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.757366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s5tv5"
Jul 20 13:39:49.769362 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:39:49.769331    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b952a9_014a_4fb2_ba7c_ad22636a23e3.slice/crio-1b689231041c6ab56d4e7b14aeecc7296e82f48a28d1e33f5d29a66a3026897f WatchSource:0}: Error finding container 1b689231041c6ab56d4e7b14aeecc7296e82f48a28d1e33f5d29a66a3026897f: Status 404 returned error can't find the container with id 1b689231041c6ab56d4e7b14aeecc7296e82f48a28d1e33f5d29a66a3026897f
Jul 20 13:39:49.789013 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:49.788973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5tv5" event={"ID":"e1b952a9-014a-4fb2-ba7c-ad22636a23e3","Type":"ContainerStarted","Data":"1b689231041c6ab56d4e7b14aeecc7296e82f48a28d1e33f5d29a66a3026897f"}
Jul 20 13:39:51.503700 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:51.503665    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64f8648b85-2mk59"]
Jul 20 13:39:51.798392 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:51.798293    2559 generic.go:356] "Generic (PLEG): container finished" podID="e1b952a9-014a-4fb2-ba7c-ad22636a23e3" containerID="8ada2c228d5bfc9ee6ff811f5d7d9e524b8b1680f365d50734c8dafeda6d7f3b" exitCode=0
Jul 20 13:39:51.798545 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:51.798389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5tv5" event={"ID":"e1b952a9-014a-4fb2-ba7c-ad22636a23e3","Type":"ContainerDied","Data":"8ada2c228d5bfc9ee6ff811f5d7d9e524b8b1680f365d50734c8dafeda6d7f3b"}
Jul 20 13:39:52.641837 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:52.641808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7j7rl"
Jul 20 13:39:52.804360 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:52.804324    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5tv5" event={"ID":"e1b952a9-014a-4fb2-ba7c-ad22636a23e3","Type":"ContainerStarted","Data":"d53fb53a9aaee916a4b6fe2a8753aa172b4bdebaaf470de40d15a98f1a58e6e0"}
Jul 20 13:39:52.804527 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:39:52.804376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s5tv5" event={"ID":"e1b952a9-014a-4fb2-ba7c-ad22636a23e3","Type":"ContainerStarted","Data":"73fcce633d6e0a566c87c98ca0d8750b7f0ed0d1211bb7ab2a8a254bb41326fa"}
Jul 20 13:40:16.523724 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.523654    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64f8648b85-2mk59" podUID="f19134bd-15a2-4e41-b5e4-a2301e4e100a" containerName="registry" containerID="cri-o://39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9" gracePeriod=30
Jul 20 13:40:16.767798 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.767765    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:40:16.791458 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.791356    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s5tv5" podStartSLOduration=26.366137808 podStartE2EDuration="27.791332976s" totalImagesPullingTime="1.352764408s" totalInitContainerRuntime="72.43076ms" isStatefulPod=true podCreationTimestamp="2026-07-20 13:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:52.837537799 +0000 UTC m=+98.112782328" watchObservedRunningTime="2026-07-20 13:40:16.791332976 +0000 UTC m=+122.066577506"
Jul 20 13:40:16.859366 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859328    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-trusted-ca\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859392    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-installation-pull-secrets\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859431    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-image-registry-private-configuration\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859453    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn224\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-kube-api-access-rn224\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859494    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859518    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f19134bd-15a2-4e41-b5e4-a2301e4e100a-ca-trust-extracted\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859564 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-bound-sa-token\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859870 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-certificates\") pod \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\" (UID: \"f19134bd-15a2-4e41-b5e4-a2301e4e100a\") "
Jul 20 13:40:16.859991 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.859861    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:16.860580 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.860514    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:16.862553 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.862522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:40:16.862653 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.862616    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-kube-api-access-rn224" (OuterVolumeSpecName: "kube-api-access-rn224") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "kube-api-access-rn224". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:16.862730 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.862659    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:40:16.862793 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.862750    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:16.862844 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.862796    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:16.868907 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.868874    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19134bd-15a2-4e41-b5e4-a2301e4e100a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f19134bd-15a2-4e41-b5e4-a2301e4e100a" (UID: "f19134bd-15a2-4e41-b5e4-a2301e4e100a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:16.895782 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.895748    2559 generic.go:356] "Generic (PLEG): container finished" podID="f19134bd-15a2-4e41-b5e4-a2301e4e100a" containerID="39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9" exitCode=0
Jul 20 13:40:16.895944 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.895794    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f8648b85-2mk59"
Jul 20 13:40:16.895944 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.895799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f8648b85-2mk59" event={"ID":"f19134bd-15a2-4e41-b5e4-a2301e4e100a","Type":"ContainerDied","Data":"39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9"}
Jul 20 13:40:16.895944 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.895865    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f8648b85-2mk59" event={"ID":"f19134bd-15a2-4e41-b5e4-a2301e4e100a","Type":"ContainerDied","Data":"2e6c6f4628462e0789e65b8a7c8ac7ce735cdf014d58755927b54c01e747b5a3"}
Jul 20 13:40:16.895944 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.895886    2559 scope.go:117] "RemoveContainer" containerID="39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9"
Jul 20 13:40:16.904950 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.904928    2559 scope.go:117] "RemoveContainer" containerID="39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9"
Jul 20 13:40:16.905219 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:40:16.905195    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9\": container with ID starting with 39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9 not found: ID does not exist" containerID="39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9"
Jul 20 13:40:16.905320 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.905224    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9"} err="failed to get container status \"39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9\": rpc error: code = NotFound desc = could not find container \"39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9\": container with ID starting with 39d6429e3aa5b7fc19f6d8fb2f4fb8055d2bb55fd6163b20ad784855b5a925c9 not found: ID does not exist"
Jul 20 13:40:16.917000 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.916978    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64f8648b85-2mk59"]
Jul 20 13:40:16.921460 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.921438    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64f8648b85-2mk59"]
Jul 20 13:40:16.960064 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960031    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-bound-sa-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960064 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960064    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-certificates\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960077    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f19134bd-15a2-4e41-b5e4-a2301e4e100a-trusted-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960086    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-installation-pull-secrets\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960095    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f19134bd-15a2-4e41-b5e4-a2301e4e100a-image-registry-private-configuration\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960103    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn224\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-kube-api-access-rn224\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960111    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f19134bd-15a2-4e41-b5e4-a2301e4e100a-registry-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:16.960282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:16.960119    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f19134bd-15a2-4e41-b5e4-a2301e4e100a-ca-trust-extracted\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:40:17.191989 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:17.191956    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19134bd-15a2-4e41-b5e4-a2301e4e100a" path="/var/lib/kubelet/pods/f19134bd-15a2-4e41-b5e4-a2301e4e100a/volumes"
Jul 20 13:40:22.918963 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:22.918928    2559 generic.go:356] "Generic (PLEG): container finished" podID="8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af" containerID="b093a653477c68a38d392624e99ee397552daea5b9e740371fb807c00fb7d1e8" exitCode=0
Jul 20 13:40:22.919526 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:22.919012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d72ts" event={"ID":"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af","Type":"ContainerDied","Data":"b093a653477c68a38d392624e99ee397552daea5b9e740371fb807c00fb7d1e8"}
Jul 20 13:40:22.919526 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:22.919482    2559 scope.go:117] "RemoveContainer" containerID="b093a653477c68a38d392624e99ee397552daea5b9e740371fb807c00fb7d1e8"
Jul 20 13:40:22.920462 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:22.920443    2559 generic.go:356] "Generic (PLEG): container finished" podID="104176dc-4e6f-4a05-b180-7e2517289df2" containerID="b84495ac262db4ded343c98f58946f3a4dc9a6101a659a8851f7532e5443de0f" exitCode=0
Jul 20 13:40:22.920555 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:22.920502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr" event={"ID":"104176dc-4e6f-4a05-b180-7e2517289df2","Type":"ContainerDied","Data":"b84495ac262db4ded343c98f58946f3a4dc9a6101a659a8851f7532e5443de0f"}
Jul 20 13:40:22.920777 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:22.920767    2559 scope.go:117] "RemoveContainer" containerID="b84495ac262db4ded343c98f58946f3a4dc9a6101a659a8851f7532e5443de0f"
Jul 20 13:40:23.733795 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:23.733752    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m52s_f6989115-a0ea-4c88-ab51-b3187ec6157f/serve-healthcheck-canary/0.log"
Jul 20 13:40:23.926409 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:23.926367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-d72ts" event={"ID":"8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af","Type":"ContainerStarted","Data":"60c555c72be6b67109e1d8977d593e625d735cb738a085b3e2d9f0930554027e"}
Jul 20 13:40:23.928075 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:23.928047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gplzr" event={"ID":"104176dc-4e6f-4a05-b180-7e2517289df2","Type":"ContainerStarted","Data":"97b16ac2749d7e2882ad7558e50b1649b23cf71d15ec51e75fbcc496f321eccb"}
Jul 20 13:40:37.984059 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:37.984021    2559 generic.go:356] "Generic (PLEG): container finished" podID="536c169b-0244-4932-b303-7e06a972906f" containerID="9fadbef5ebe16428c285df00079f88a6121a24beccbe65a6e087811b0cbb1749" exitCode=0
Jul 20 13:40:37.984485 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:37.984090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq" event={"ID":"536c169b-0244-4932-b303-7e06a972906f","Type":"ContainerDied","Data":"9fadbef5ebe16428c285df00079f88a6121a24beccbe65a6e087811b0cbb1749"}
Jul 20 13:40:37.984485 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:37.984428    2559 scope.go:117] "RemoveContainer" containerID="9fadbef5ebe16428c285df00079f88a6121a24beccbe65a6e087811b0cbb1749"
Jul 20 13:40:38.990187 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:40:38.990131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fwbbq" event={"ID":"536c169b-0244-4932-b303-7e06a972906f","Type":"ContainerStarted","Data":"123a77cc94b788b204fd542ebc76cb21da6e761b3f27914fca5944b292e77411"}
Jul 20 13:43:15.123959 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:15.123928    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:43:15.130174 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:15.130130    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:43:15.135525 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:15.135493    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 13:43:31.450433 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.450397    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"]
Jul 20 13:43:31.452768 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.450757    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19134bd-15a2-4e41-b5e4-a2301e4e100a" containerName="registry"
Jul 20 13:43:31.452768 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.450782    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19134bd-15a2-4e41-b5e4-a2301e4e100a" containerName="registry"
Jul 20 13:43:31.452768 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.450834    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19134bd-15a2-4e41-b5e4-a2301e4e100a" containerName="registry"
Jul 20 13:43:31.453682 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.453667    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.455960 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.455937    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 13:43:31.456111 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.455989    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cbzp5\""
Jul 20 13:43:31.456883 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.456867    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:43:31.462346 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.462322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"]
Jul 20 13:43:31.513423 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.513384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj5nt\" (UniqueName: \"kubernetes.io/projected/2b095b98-b04f-4697-a6fc-d7b0e5817b05-kube-api-access-cj5nt\") pod \"openshift-lws-operator-fd8ccff4c-hd8x4\" (UID: \"2b095b98-b04f-4697-a6fc-d7b0e5817b05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.513610 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.513447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b095b98-b04f-4697-a6fc-d7b0e5817b05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hd8x4\" (UID: \"2b095b98-b04f-4697-a6fc-d7b0e5817b05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.614073 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.614030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj5nt\" (UniqueName: \"kubernetes.io/projected/2b095b98-b04f-4697-a6fc-d7b0e5817b05-kube-api-access-cj5nt\") pod \"openshift-lws-operator-fd8ccff4c-hd8x4\" (UID: \"2b095b98-b04f-4697-a6fc-d7b0e5817b05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.614292 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.614106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b095b98-b04f-4697-a6fc-d7b0e5817b05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hd8x4\" (UID: \"2b095b98-b04f-4697-a6fc-d7b0e5817b05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.614538 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.614516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b095b98-b04f-4697-a6fc-d7b0e5817b05-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hd8x4\" (UID: \"2b095b98-b04f-4697-a6fc-d7b0e5817b05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.622654 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.622624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj5nt\" (UniqueName: \"kubernetes.io/projected/2b095b98-b04f-4697-a6fc-d7b0e5817b05-kube-api-access-cj5nt\") pod \"openshift-lws-operator-fd8ccff4c-hd8x4\" (UID: \"2b095b98-b04f-4697-a6fc-d7b0e5817b05\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.763804 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.763702    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"
Jul 20 13:43:31.898709 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.898673    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4"]
Jul 20 13:43:31.905413 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:31.905390    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:43:32.623625 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:32.623575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4" event={"ID":"2b095b98-b04f-4697-a6fc-d7b0e5817b05","Type":"ContainerStarted","Data":"66b4425d837ad0fed621d04ea7c249d439e2d6ef3aba8c33b670dd5458857a35"}
Jul 20 13:43:34.635963 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:34.635873    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4" event={"ID":"2b095b98-b04f-4697-a6fc-d7b0e5817b05","Type":"ContainerStarted","Data":"7a3f4ce0b42fd729b93bb06553cee043f9bb6b5c1a3bd84fa3a7ec29e6d76b42"}
Jul 20 13:43:34.652327 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:34.652276    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hd8x4" podStartSLOduration=1.224937055 podStartE2EDuration="3.652258563s" totalImagesPullingTime="2.427321508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:43:34.650939208 +0000 UTC m=+319.926183732" watchObservedRunningTime="2026-07-20 13:43:34.652258563 +0000 UTC m=+319.927503092"
Jul 20 13:43:54.091298 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.091257    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"]
Jul 20 13:43:54.098978 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.098948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.101833 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.101804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 13:43:54.101833 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.101819    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 13:43:54.102018 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.101861    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 13:43:54.102018 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.101819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-khdv6\""
Jul 20 13:43:54.104366 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.104345    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 13:43:54.121651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.121617    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"]
Jul 20 13:43:54.195859 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.195827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.195859 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.195864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.196085 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.195891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-tmp\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.196085 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.195911    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccs7r\" (UniqueName: \"kubernetes.io/projected/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-kube-api-access-ccs7r\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.196085 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.195977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-manifests\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.297222 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.297153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-manifests\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.297407 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.297255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.297407 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.297280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.297407 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.297308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-tmp\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.297407 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.297331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccs7r\" (UniqueName: \"kubernetes.io/projected/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-kube-api-access-ccs7r\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.297626 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.297535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-manifests\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.299777 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.299751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-tmp\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.299918 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.299903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.299965 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.299947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.306625 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.306597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccs7r\" (UniqueName: \"kubernetes.io/projected/a9763c5e-6309-4aa5-9c18-db3492fe8cf2-kube-api-access-ccs7r\") pod \"opendatahub-operator-controller-manager-5b98c56445-pvfnz\" (UID: \"a9763c5e-6309-4aa5-9c18-db3492fe8cf2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.409498 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.409459    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:43:54.550475 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.550430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"]
Jul 20 13:43:54.553388 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:43:54.553365    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9763c5e_6309_4aa5_9c18_db3492fe8cf2.slice/crio-def904b0d49d7c7608750966ba5140b123d964823a2857879593d0358e37f6d2 WatchSource:0}: Error finding container def904b0d49d7c7608750966ba5140b123d964823a2857879593d0358e37f6d2: Status 404 returned error can't find the container with id def904b0d49d7c7608750966ba5140b123d964823a2857879593d0358e37f6d2
Jul 20 13:43:54.709960 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:54.709876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz" event={"ID":"a9763c5e-6309-4aa5-9c18-db3492fe8cf2","Type":"ContainerStarted","Data":"def904b0d49d7c7608750966ba5140b123d964823a2857879593d0358e37f6d2"}
Jul 20 13:43:57.728977 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:57.728940    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz" event={"ID":"a9763c5e-6309-4aa5-9c18-db3492fe8cf2","Type":"ContainerStarted","Data":"7af823894d106dc19cab7220d4cfb8d36ad76600c01d4ee600f6e8c03af26324"}
Jul 20 13:43:59.738701 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:59.738661    2559 generic.go:356] "Generic (PLEG): container finished" podID="a9763c5e-6309-4aa5-9c18-db3492fe8cf2" containerID="7af823894d106dc19cab7220d4cfb8d36ad76600c01d4ee600f6e8c03af26324" exitCode=0
Jul 20 13:43:59.739109 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:43:59.738712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz" event={"ID":"a9763c5e-6309-4aa5-9c18-db3492fe8cf2","Type":"ContainerDied","Data":"7af823894d106dc19cab7220d4cfb8d36ad76600c01d4ee600f6e8c03af26324"}
Jul 20 13:44:00.745054 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:00.745022    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz" event={"ID":"a9763c5e-6309-4aa5-9c18-db3492fe8cf2","Type":"ContainerStarted","Data":"8d46e285e35171dd78184756d14b0dc226b86b68626144f47edfdd4e06958f0b"}
Jul 20 13:44:00.745466 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:00.745243    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:44:00.768759 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:00.768699    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz" podStartSLOduration=2.291376519 podStartE2EDuration="6.76867844s" totalImagesPullingTime="3.360949452s" totalInitContainerRuntime="1.116352469s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:43:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:00.767290946 +0000 UTC m=+346.042535474" watchObservedRunningTime="2026-07-20 13:44:00.76867844 +0000 UTC m=+346.043922971"
Jul 20 13:44:11.751838 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:11.751764    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b98c56445-pvfnz"
Jul 20 13:44:19.845642 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.845604    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8667c86565-smhqm"]
Jul 20 13:44:19.850226 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.850206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:19.854087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.854064    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 13:44:19.854235 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.854063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 13:44:19.854235 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.854143    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 13:44:19.857310 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.857287    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 13:44:19.875848 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.875814    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8667c86565-smhqm"]
Jul 20 13:44:19.902674 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.902644    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba04140c-4fad-4fd9-99f7-030465764932-tls-certs\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:19.902845 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.902701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba04140c-4fad-4fd9-99f7-030465764932-tmp\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:19.902845 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:19.902774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc87p\" (UniqueName: \"kubernetes.io/projected/ba04140c-4fad-4fd9-99f7-030465764932-kube-api-access-dc87p\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.003951 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.003916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba04140c-4fad-4fd9-99f7-030465764932-tls-certs\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.004149 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.003968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba04140c-4fad-4fd9-99f7-030465764932-tmp\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.004149 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.003998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc87p\" (UniqueName: \"kubernetes.io/projected/ba04140c-4fad-4fd9-99f7-030465764932-kube-api-access-dc87p\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.004149 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:44:20.004078    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 20 13:44:20.004149 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:44:20.004146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba04140c-4fad-4fd9-99f7-030465764932-tls-certs podName:ba04140c-4fad-4fd9-99f7-030465764932 nodeName:}" failed. No retries permitted until 2026-07-20 13:44:20.504130191 +0000 UTC m=+365.779374698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ba04140c-4fad-4fd9-99f7-030465764932-tls-certs") pod "kube-auth-proxy-8667c86565-smhqm" (UID: "ba04140c-4fad-4fd9-99f7-030465764932") : secret "kube-auth-proxy-tls" not found
Jul 20 13:44:20.006448 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.006425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba04140c-4fad-4fd9-99f7-030465764932-tmp\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.016263 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.016238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc87p\" (UniqueName: \"kubernetes.io/projected/ba04140c-4fad-4fd9-99f7-030465764932-kube-api-access-dc87p\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.508841 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.508808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba04140c-4fad-4fd9-99f7-030465764932-tls-certs\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.511438 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.511413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba04140c-4fad-4fd9-99f7-030465764932-tls-certs\") pod \"kube-auth-proxy-8667c86565-smhqm\" (UID: \"ba04140c-4fad-4fd9-99f7-030465764932\") " pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.760453 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.760347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm"
Jul 20 13:44:20.911364 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:20.911335    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8667c86565-smhqm"]
Jul 20 13:44:20.913962 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:44:20.913935    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba04140c_4fad_4fd9_99f7_030465764932.slice/crio-aaeb1808d5790a3e53b226daf566b6fcd4a85fffee49537bf1ea9c0c0464b6ea WatchSource:0}: Error finding container aaeb1808d5790a3e53b226daf566b6fcd4a85fffee49537bf1ea9c0c0464b6ea: Status 404 returned error can't find the container with id aaeb1808d5790a3e53b226daf566b6fcd4a85fffee49537bf1ea9c0c0464b6ea
Jul 20 13:44:21.369901 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.369862    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"]
Jul 20 13:44:21.374366 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.374341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.378584 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.378558    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 13:44:21.378584 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.378565    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 13:44:21.378801 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.378664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6zbxj\""
Jul 20 13:44:21.378801 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.378731    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 13:44:21.378987 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.378910    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 13:44:21.403520 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.403485    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"]
Jul 20 13:44:21.417004 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.416973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.417189 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.417021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.417189 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.417097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.417189 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.417183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda540af-3321-4420-9e72-bab746190f0d-local-certs\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.417326 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.417224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-istio-token\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.417326 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.417262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvt2\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-kube-api-access-wrvt2\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.417421 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.417402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.518869 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.518830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvt2\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-kube-api-access-wrvt2\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519059 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.518897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519059 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.518926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519192 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.519053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519192 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.519112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519192 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.519173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda540af-3321-4420-9e72-bab746190f0d-local-certs\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519342 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.519208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-istio-token\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.519596 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.519562    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.522114 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.522069    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.522508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.522484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.522738 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.522717    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda540af-3321-4420-9e72-bab746190f0d-local-certs\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.522918 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.522895    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.533995 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.533970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-istio-token\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.538857 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.538827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvt2\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-kube-api-access-wrvt2\") pod \"istiod-openshift-gateway-7574459656-rlqbj\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.685413 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.685375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:21.831121 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.831087    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm" event={"ID":"ba04140c-4fad-4fd9-99f7-030465764932","Type":"ContainerStarted","Data":"aaeb1808d5790a3e53b226daf566b6fcd4a85fffee49537bf1ea9c0c0464b6ea"}
Jul 20 13:44:21.878538 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:44:21.878505    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda540af_3321_4420_9e72_bab746190f0d.slice/crio-98050c8db5699beb4643432a4c38dd4fad28bf0cb70c99c5a7dd14e166ed8868 WatchSource:0}: Error finding container 98050c8db5699beb4643432a4c38dd4fad28bf0cb70c99c5a7dd14e166ed8868: Status 404 returned error can't find the container with id 98050c8db5699beb4643432a4c38dd4fad28bf0cb70c99c5a7dd14e166ed8868
Jul 20 13:44:21.878892 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:21.878867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"]
Jul 20 13:44:22.837238 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:22.837202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" event={"ID":"bda540af-3321-4420-9e72-bab746190f0d","Type":"ContainerStarted","Data":"98050c8db5699beb4643432a4c38dd4fad28bf0cb70c99c5a7dd14e166ed8868"}
Jul 20 13:44:23.844471 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:23.844435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm" event={"ID":"ba04140c-4fad-4fd9-99f7-030465764932","Type":"ContainerStarted","Data":"53af50846535a7fb2286b5da2b0a4bea76724290c3a9bfff00c8f706cd9cb829"}
Jul 20 13:44:23.913515 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:23.913445    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8667c86565-smhqm" podStartSLOduration=2.8617818809999997 podStartE2EDuration="4.913422226s" totalImagesPullingTime="2.051640345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:23.908044671 +0000 UTC m=+369.183289201" watchObservedRunningTime="2026-07-20 13:44:23.913422226 +0000 UTC m=+369.188666947"
Jul 20 13:44:24.858397 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:24.858360    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:44:24.858772 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:24.858437    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:44:25.708151 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.708111    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"]
Jul 20 13:44:25.711800 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.711774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.712118 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.712092    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-slglw"]
Jul 20 13:44:25.715643 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.715620    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.717120 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.717102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fjzqq\""
Jul 20 13:44:25.717240 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.717176    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 13:44:25.717978 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.717960    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 13:44:25.717978 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.717974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7ngq7\""
Jul 20 13:44:25.730874 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.730851    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-slglw"]
Jul 20 13:44:25.739749 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.739722    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"]
Jul 20 13:44:25.755258 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.755230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdrf\" (UniqueName: \"kubernetes.io/projected/d7526677-1c32-4e6a-a214-04431510502f-kube-api-access-xtdrf\") pod \"llmisvc-controller-manager-777c6bd7d5-kq7ml\" (UID: \"d7526677-1c32-4e6a-a214-04431510502f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.755417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.755281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46901df5-f843-46d2-8ba2-5082f9fd86a8-cert\") pod \"kserve-controller-manager-d6f4b65b8-slglw\" (UID: \"46901df5-f843-46d2-8ba2-5082f9fd86a8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.755417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.755381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7526677-1c32-4e6a-a214-04431510502f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kq7ml\" (UID: \"d7526677-1c32-4e6a-a214-04431510502f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.755417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.755411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v65pj\" (UniqueName: \"kubernetes.io/projected/46901df5-f843-46d2-8ba2-5082f9fd86a8-kube-api-access-v65pj\") pod \"kserve-controller-manager-d6f4b65b8-slglw\" (UID: \"46901df5-f843-46d2-8ba2-5082f9fd86a8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.854229 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.854194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" event={"ID":"bda540af-3321-4420-9e72-bab746190f0d","Type":"ContainerStarted","Data":"09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110"}
Jul 20 13:44:25.854449 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.854427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:25.855791 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.855766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7526677-1c32-4e6a-a214-04431510502f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kq7ml\" (UID: \"d7526677-1c32-4e6a-a214-04431510502f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.855945 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.855807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v65pj\" (UniqueName: \"kubernetes.io/projected/46901df5-f843-46d2-8ba2-5082f9fd86a8-kube-api-access-v65pj\") pod \"kserve-controller-manager-d6f4b65b8-slglw\" (UID: \"46901df5-f843-46d2-8ba2-5082f9fd86a8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.855945 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.855864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdrf\" (UniqueName: \"kubernetes.io/projected/d7526677-1c32-4e6a-a214-04431510502f-kube-api-access-xtdrf\") pod \"llmisvc-controller-manager-777c6bd7d5-kq7ml\" (UID: \"d7526677-1c32-4e6a-a214-04431510502f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.855945 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.855901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46901df5-f843-46d2-8ba2-5082f9fd86a8-cert\") pod \"kserve-controller-manager-d6f4b65b8-slglw\" (UID: \"46901df5-f843-46d2-8ba2-5082f9fd86a8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.856099 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.856037    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rlqbj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 13:44:25.856179 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.856128    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" podUID="bda540af-3321-4420-9e72-bab746190f0d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:44:25.858431 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.858411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7526677-1c32-4e6a-a214-04431510502f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kq7ml\" (UID: \"d7526677-1c32-4e6a-a214-04431510502f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.858737 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.858415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46901df5-f843-46d2-8ba2-5082f9fd86a8-cert\") pod \"kserve-controller-manager-d6f4b65b8-slglw\" (UID: \"46901df5-f843-46d2-8ba2-5082f9fd86a8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.871862 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.871838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdrf\" (UniqueName: \"kubernetes.io/projected/d7526677-1c32-4e6a-a214-04431510502f-kube-api-access-xtdrf\") pod \"llmisvc-controller-manager-777c6bd7d5-kq7ml\" (UID: \"d7526677-1c32-4e6a-a214-04431510502f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:25.871956 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.871917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v65pj\" (UniqueName: \"kubernetes.io/projected/46901df5-f843-46d2-8ba2-5082f9fd86a8-kube-api-access-v65pj\") pod \"kserve-controller-manager-d6f4b65b8-slglw\" (UID: \"46901df5-f843-46d2-8ba2-5082f9fd86a8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:25.890893 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.890825    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" podStartSLOduration=1.913455967 podStartE2EDuration="4.890800845s" totalImagesPullingTime="2.977344878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:25.890583129 +0000 UTC m=+371.165827678" watchObservedRunningTime="2026-07-20 13:44:25.890800845 +0000 UTC m=+371.166045375"
Jul 20 13:44:25.935957 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.935919    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"]
Jul 20 13:44:25.939375 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.939350    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:25.942645 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.942625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qwzqh\""
Jul 20 13:44:25.970723 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:25.970653    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"]
Jul 20 13:44:26.023339 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.023309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:26.029191 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.029126    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:26.057499 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057691 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b15826-0a53-4243-aab7-b7765c6555e8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057691 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057802 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b15826-0a53-4243-aab7-b7765c6555e8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057802 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057719    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khfl2\" (UniqueName: \"kubernetes.io/projected/52b15826-0a53-4243-aab7-b7765c6555e8-kube-api-access-khfl2\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057802 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b15826-0a53-4243-aab7-b7765c6555e8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057952 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057952 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.057952 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.057920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159084 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159084 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b15826-0a53-4243-aab7-b7765c6555e8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159084 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159389 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b15826-0a53-4243-aab7-b7765c6555e8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159389 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khfl2\" (UniqueName: \"kubernetes.io/projected/52b15826-0a53-4243-aab7-b7765c6555e8-kube-api-access-khfl2\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159389 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b15826-0a53-4243-aab7-b7765c6555e8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159389 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159389 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159389 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159718 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159821 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.159956 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159935    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.160041 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.159977    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.160601 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.160533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b15826-0a53-4243-aab7-b7765c6555e8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.162286 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.162253    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b15826-0a53-4243-aab7-b7765c6555e8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.163112 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.163088    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b15826-0a53-4243-aab7-b7765c6555e8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.172239 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.172210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khfl2\" (UniqueName: \"kubernetes.io/projected/52b15826-0a53-4243-aab7-b7765c6555e8-kube-api-access-khfl2\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.173998 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.173904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b15826-0a53-4243-aab7-b7765c6555e8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rpmgh\" (UID: \"52b15826-0a53-4243-aab7-b7765c6555e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.188247 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.188223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"]
Jul 20 13:44:26.189700 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:44:26.189669    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7526677_1c32_4e6a_a214_04431510502f.slice/crio-822b92dcba589cdbd573ea801623aaedb46bf92a83fdd0225022bc305c5f699f WatchSource:0}: Error finding container 822b92dcba589cdbd573ea801623aaedb46bf92a83fdd0225022bc305c5f699f: Status 404 returned error can't find the container with id 822b92dcba589cdbd573ea801623aaedb46bf92a83fdd0225022bc305c5f699f
Jul 20 13:44:26.208703 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.208673    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-slglw"]
Jul 20 13:44:26.209961 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:44:26.209938    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46901df5_f843_46d2_8ba2_5082f9fd86a8.slice/crio-e8a70507826be5bc74988a61bf9c407f9f2858c51d9b535eb054c6fc9e6197bc WatchSource:0}: Error finding container e8a70507826be5bc74988a61bf9c407f9f2858c51d9b535eb054c6fc9e6197bc: Status 404 returned error can't find the container with id e8a70507826be5bc74988a61bf9c407f9f2858c51d9b535eb054c6fc9e6197bc
Jul 20 13:44:26.250999 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.250919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:26.389638 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.389608    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"]
Jul 20 13:44:26.393105 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:44:26.393077    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b15826_0a53_4243_aab7_b7765c6555e8.slice/crio-3743ff216480663fba90c5d1418a51c03d40a07af66d1661b882ebf0add4c36c WatchSource:0}: Error finding container 3743ff216480663fba90c5d1418a51c03d40a07af66d1661b882ebf0add4c36c: Status 404 returned error can't find the container with id 3743ff216480663fba90c5d1418a51c03d40a07af66d1661b882ebf0add4c36c
Jul 20 13:44:26.861489 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.861442    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw" event={"ID":"46901df5-f843-46d2-8ba2-5082f9fd86a8","Type":"ContainerStarted","Data":"e8a70507826be5bc74988a61bf9c407f9f2858c51d9b535eb054c6fc9e6197bc"}
Jul 20 13:44:26.862911 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.862883    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml" event={"ID":"d7526677-1c32-4e6a-a214-04431510502f","Type":"ContainerStarted","Data":"822b92dcba589cdbd573ea801623aaedb46bf92a83fdd0225022bc305c5f699f"}
Jul 20 13:44:26.864453 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.864424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh" event={"ID":"52b15826-0a53-4243-aab7-b7765c6555e8","Type":"ContainerStarted","Data":"3743ff216480663fba90c5d1418a51c03d40a07af66d1661b882ebf0add4c36c"}
Jul 20 13:44:26.865419 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:26.865342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:28.128781 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:28.128741    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"]
Jul 20 13:44:28.877531 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:28.877343    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" podUID="bda540af-3321-4420-9e72-bab746190f0d" containerName="discovery" containerID="cri-o://09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110" gracePeriod=30
Jul 20 13:44:29.806044 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.806006    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:44:29.806587 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.806076    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:44:29.806587 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.806110    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:44:29.825863 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.825828    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:29.883252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.883171    2559 generic.go:356] "Generic (PLEG): container finished" podID="bda540af-3321-4420-9e72-bab746190f0d" containerID="09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110" exitCode=0
Jul 20 13:44:29.883252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.883197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" event={"ID":"bda540af-3321-4420-9e72-bab746190f0d","Type":"ContainerDied","Data":"09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110"}
Jul 20 13:44:29.883252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.883224    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"
Jul 20 13:44:29.883525 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.883261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj" event={"ID":"bda540af-3321-4420-9e72-bab746190f0d","Type":"ContainerDied","Data":"98050c8db5699beb4643432a4c38dd4fad28bf0cb70c99c5a7dd14e166ed8868"}
Jul 20 13:44:29.883525 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.883290    2559 scope.go:117] "RemoveContainer" containerID="09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110"
Jul 20 13:44:29.888853 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.888830    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda540af-3321-4420-9e72-bab746190f0d-local-certs\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.888973 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.888881    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-ca-configmap\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.888973 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.888947    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-cacerts\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.889099 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.888974    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-kubeconfig\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.889099 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.889000    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrvt2\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-kube-api-access-wrvt2\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.889099 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.889031    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-istio-token\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.889099 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.889081    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-dns-cert\") pod \"bda540af-3321-4420-9e72-bab746190f0d\" (UID: \"bda540af-3321-4420-9e72-bab746190f0d\") "
Jul 20 13:44:29.889648 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.889615    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:44:29.891482 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.891452    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda540af-3321-4420-9e72-bab746190f0d-local-certs" (OuterVolumeSpecName: "local-certs") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:44:29.891874 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.891850    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-cacerts" (OuterVolumeSpecName: "cacerts") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:44:29.891968 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.891948    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-kube-api-access-wrvt2" (OuterVolumeSpecName: "kube-api-access-wrvt2") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "kube-api-access-wrvt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:44:29.892126 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.892102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:44:29.892242 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.892138    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:44:29.892667 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.892652    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bda540af-3321-4420-9e72-bab746190f0d" (UID: "bda540af-3321-4420-9e72-bab746190f0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:44:29.990328 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990291    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bda540af-3321-4420-9e72-bab746190f0d-local-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:29.990328 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990330    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-ca-configmap\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:29.990539 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990350    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-cacerts\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:29.990539 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990365    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-kubeconfig\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:29.990539 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990379    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrvt2\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-kube-api-access-wrvt2\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:29.990539 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990393    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bda540af-3321-4420-9e72-bab746190f0d-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:29.990539 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:29.990406    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bda540af-3321-4420-9e72-bab746190f0d-istio-csr-dns-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:44:30.208727 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.208695    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"]
Jul 20 13:44:30.216467 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.216436    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rlqbj"]
Jul 20 13:44:30.409554 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.409533    2559 scope.go:117] "RemoveContainer" containerID="09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110"
Jul 20 13:44:30.409863 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:44:30.409844    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110\": container with ID starting with 09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110 not found: ID does not exist" containerID="09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110"
Jul 20 13:44:30.409943 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.409873    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110"} err="failed to get container status \"09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110\": rpc error: code = NotFound desc = could not find container \"09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110\": container with ID starting with 09624d17ca616e675cce88db2af092b6d8b4cfced644748d950c06731a1d8110 not found: ID does not exist"
Jul 20 13:44:30.889276 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.889186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh" event={"ID":"52b15826-0a53-4243-aab7-b7765c6555e8","Type":"ContainerStarted","Data":"edf252f8e0f6d683740ec9144b2712b348816546b65bc20214726a19eb558620"}
Jul 20 13:44:30.891888 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.891855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw" event={"ID":"46901df5-f843-46d2-8ba2-5082f9fd86a8","Type":"ContainerStarted","Data":"5a59dfb48727b9bbe3f2e1f82bd26eb668f75663508aa3a2d62e4fc1f4f4c9a5"}
Jul 20 13:44:30.892042 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.891974    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:44:30.893552 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.893529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml" event={"ID":"d7526677-1c32-4e6a-a214-04431510502f","Type":"ContainerStarted","Data":"f415f32553d223e6bde50e72153d11e22751a7adef0777272aa33ad83e8bfac4"}
Jul 20 13:44:30.893725 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.893694    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:44:30.912084 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.912031    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh" podStartSLOduration=2.5014658990000003 podStartE2EDuration="5.912014382s" totalImagesPullingTime="3.410548483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:30.910469866 +0000 UTC m=+376.185714394" watchObservedRunningTime="2026-07-20 13:44:30.912014382 +0000 UTC m=+376.187258911"
Jul 20 13:44:30.926226 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.926152    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml" podStartSLOduration=1.650174407 podStartE2EDuration="5.926135056s" totalImagesPullingTime="4.275960649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:30.925208012 +0000 UTC m=+376.200452546" watchObservedRunningTime="2026-07-20 13:44:30.926135056 +0000 UTC m=+376.201379585"
Jul 20 13:44:30.941252 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:30.941201    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw" podStartSLOduration=2.433651807 podStartE2EDuration="5.941185367s" totalImagesPullingTime="3.50753356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:44:30.940326802 +0000 UTC m=+376.215571332" watchObservedRunningTime="2026-07-20 13:44:30.941185367 +0000 UTC m=+376.216429904"
Jul 20 13:44:31.196962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:31.196921    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda540af-3321-4420-9e72-bab746190f0d" path="/var/lib/kubelet/pods/bda540af-3321-4420-9e72-bab746190f0d/volumes"
Jul 20 13:44:31.251960 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:31.251915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:31.256615 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:31.256589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:31.898881 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:31.898851    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:44:31.899775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:44:31.899757    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rpmgh"
Jul 20 13:45:01.901369 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:01.901338    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kq7ml"
Jul 20 13:45:01.904529 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:01.904507    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-slglw"
Jul 20 13:45:15.525884 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.525794    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4pgd"]
Jul 20 13:45:15.526305 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.526145    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda540af-3321-4420-9e72-bab746190f0d" containerName="discovery"
Jul 20 13:45:15.526305 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.526172    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda540af-3321-4420-9e72-bab746190f0d" containerName="discovery"
Jul 20 13:45:15.526305 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.526237    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda540af-3321-4420-9e72-bab746190f0d" containerName="discovery"
Jul 20 13:45:15.530453 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.530429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:15.532837 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.532807    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 13:45:15.532999 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.532979    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 13:45:15.532999 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.532979    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4scwn\""
Jul 20 13:45:15.543308 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.543275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4pgd"]
Jul 20 13:45:15.577474 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.577428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v99t\" (UniqueName: \"kubernetes.io/projected/a75b71d6-a2c8-4217-ba57-80533d555784-kube-api-access-6v99t\") pod \"kuadrant-operator-catalog-t4pgd\" (UID: \"a75b71d6-a2c8-4217-ba57-80533d555784\") " pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:15.678921 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.678871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v99t\" (UniqueName: \"kubernetes.io/projected/a75b71d6-a2c8-4217-ba57-80533d555784-kube-api-access-6v99t\") pod \"kuadrant-operator-catalog-t4pgd\" (UID: \"a75b71d6-a2c8-4217-ba57-80533d555784\") " pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:15.689822 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.689788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v99t\" (UniqueName: \"kubernetes.io/projected/a75b71d6-a2c8-4217-ba57-80533d555784-kube-api-access-6v99t\") pod \"kuadrant-operator-catalog-t4pgd\" (UID: \"a75b71d6-a2c8-4217-ba57-80533d555784\") " pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:15.843046 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.842946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:15.892284 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.892248    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4pgd"]
Jul 20 13:45:15.979452 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:15.979419    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4pgd"]
Jul 20 13:45:15.982666 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:45:15.982637    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75b71d6_a2c8_4217_ba57_80533d555784.slice/crio-f96e2927867b89d905cb5ca9d9db2dcbde57cb5e0fe6066bce0d46fcb485cc2f WatchSource:0}: Error finding container f96e2927867b89d905cb5ca9d9db2dcbde57cb5e0fe6066bce0d46fcb485cc2f: Status 404 returned error can't find the container with id f96e2927867b89d905cb5ca9d9db2dcbde57cb5e0fe6066bce0d46fcb485cc2f
Jul 20 13:45:16.089233 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.089199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd" event={"ID":"a75b71d6-a2c8-4217-ba57-80533d555784","Type":"ContainerStarted","Data":"f96e2927867b89d905cb5ca9d9db2dcbde57cb5e0fe6066bce0d46fcb485cc2f"}
Jul 20 13:45:16.102830 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.102750    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rvsjz"]
Jul 20 13:45:16.107085 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.107061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:16.115905 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.115872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rvsjz"]
Jul 20 13:45:16.183081 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.183041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lntg\" (UniqueName: \"kubernetes.io/projected/b3f6231f-3d88-4dfc-8318-30bbffa96fbd-kube-api-access-6lntg\") pod \"kuadrant-operator-catalog-rvsjz\" (UID: \"b3f6231f-3d88-4dfc-8318-30bbffa96fbd\") " pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:16.283773 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.283736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lntg\" (UniqueName: \"kubernetes.io/projected/b3f6231f-3d88-4dfc-8318-30bbffa96fbd-kube-api-access-6lntg\") pod \"kuadrant-operator-catalog-rvsjz\" (UID: \"b3f6231f-3d88-4dfc-8318-30bbffa96fbd\") " pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:16.291842 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.291808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lntg\" (UniqueName: \"kubernetes.io/projected/b3f6231f-3d88-4dfc-8318-30bbffa96fbd-kube-api-access-6lntg\") pod \"kuadrant-operator-catalog-rvsjz\" (UID: \"b3f6231f-3d88-4dfc-8318-30bbffa96fbd\") " pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:16.418654 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.418620    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:16.556724 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:16.556699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rvsjz"]
Jul 20 13:45:16.559501 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:45:16.559476    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f6231f_3d88_4dfc_8318_30bbffa96fbd.slice/crio-2a71e15b613f58e5f9c5ac965c0cb20f3ea5920fd11f72475c1d62478e7e1536 WatchSource:0}: Error finding container 2a71e15b613f58e5f9c5ac965c0cb20f3ea5920fd11f72475c1d62478e7e1536: Status 404 returned error can't find the container with id 2a71e15b613f58e5f9c5ac965c0cb20f3ea5920fd11f72475c1d62478e7e1536
Jul 20 13:45:17.095535 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:17.095500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz" event={"ID":"b3f6231f-3d88-4dfc-8318-30bbffa96fbd","Type":"ContainerStarted","Data":"2a71e15b613f58e5f9c5ac965c0cb20f3ea5920fd11f72475c1d62478e7e1536"}
Jul 20 13:45:19.106913 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.106876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz" event={"ID":"b3f6231f-3d88-4dfc-8318-30bbffa96fbd","Type":"ContainerStarted","Data":"ad166daedec05be003e534d39b9b61794c20b87c14859aa860292f0ee7dd5408"}
Jul 20 13:45:19.108423 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.108399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd" event={"ID":"a75b71d6-a2c8-4217-ba57-80533d555784","Type":"ContainerStarted","Data":"c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658"}
Jul 20 13:45:19.108555 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.108469    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd" podUID="a75b71d6-a2c8-4217-ba57-80533d555784" containerName="registry-server" containerID="cri-o://c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658" gracePeriod=2
Jul 20 13:45:19.121867 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.121818    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz" podStartSLOduration=1.476947446 podStartE2EDuration="3.121800567s" totalImagesPullingTime="1.644853121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:19.121010357 +0000 UTC m=+424.396254889" watchObservedRunningTime="2026-07-20 13:45:19.121800567 +0000 UTC m=+424.397045073"
Jul 20 13:45:19.137599 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.137537    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd" podStartSLOduration=1.918501935 podStartE2EDuration="4.137515793s" totalImagesPullingTime="2.219013858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:19.135881603 +0000 UTC m=+424.411126135" watchObservedRunningTime="2026-07-20 13:45:19.137515793 +0000 UTC m=+424.412760324"
Jul 20 13:45:19.357506 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.357436    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:19.411887 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.411856    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v99t\" (UniqueName: \"kubernetes.io/projected/a75b71d6-a2c8-4217-ba57-80533d555784-kube-api-access-6v99t\") pod \"a75b71d6-a2c8-4217-ba57-80533d555784\" (UID: \"a75b71d6-a2c8-4217-ba57-80533d555784\") "
Jul 20 13:45:19.414302 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.414266    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75b71d6-a2c8-4217-ba57-80533d555784-kube-api-access-6v99t" (OuterVolumeSpecName: "kube-api-access-6v99t") pod "a75b71d6-a2c8-4217-ba57-80533d555784" (UID: "a75b71d6-a2c8-4217-ba57-80533d555784"). InnerVolumeSpecName "kube-api-access-6v99t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:45:19.512768 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:19.512726    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v99t\" (UniqueName: \"kubernetes.io/projected/a75b71d6-a2c8-4217-ba57-80533d555784-kube-api-access-6v99t\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:45:20.114110 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.114073    2559 generic.go:356] "Generic (PLEG): container finished" podID="a75b71d6-a2c8-4217-ba57-80533d555784" containerID="c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658" exitCode=0
Jul 20 13:45:20.114640 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.114117    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd"
Jul 20 13:45:20.114640 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.114180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd" event={"ID":"a75b71d6-a2c8-4217-ba57-80533d555784","Type":"ContainerDied","Data":"c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658"}
Jul 20 13:45:20.114640 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.114229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t4pgd" event={"ID":"a75b71d6-a2c8-4217-ba57-80533d555784","Type":"ContainerDied","Data":"f96e2927867b89d905cb5ca9d9db2dcbde57cb5e0fe6066bce0d46fcb485cc2f"}
Jul 20 13:45:20.114640 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.114251    2559 scope.go:117] "RemoveContainer" containerID="c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658"
Jul 20 13:45:20.123691 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.123673    2559 scope.go:117] "RemoveContainer" containerID="c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658"
Jul 20 13:45:20.124047 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:45:20.124028    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658\": container with ID starting with c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658 not found: ID does not exist" containerID="c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658"
Jul 20 13:45:20.124110 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.124061    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658"} err="failed to get container status \"c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658\": rpc error: code = NotFound desc = could not find container \"c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658\": container with ID starting with c13dcf41035a1e4e637f49723c94aa8edf191be3cfe0124ec9d58ca67942c658 not found: ID does not exist"
Jul 20 13:45:20.134465 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.134430    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4pgd"]
Jul 20 13:45:20.140010 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:20.139981    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t4pgd"]
Jul 20 13:45:21.192682 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:21.192634    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75b71d6-a2c8-4217-ba57-80533d555784" path="/var/lib/kubelet/pods/a75b71d6-a2c8-4217-ba57-80533d555784/volumes"
Jul 20 13:45:26.419169 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:26.419117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:26.419607 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:26.419195    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:26.442710 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:26.442685    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:27.175540 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:27.175497    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rvsjz"
Jul 20 13:45:47.414484 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.414400    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"]
Jul 20 13:45:47.414918 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.414727    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75b71d6-a2c8-4217-ba57-80533d555784" containerName="registry-server"
Jul 20 13:45:47.414918 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.414738    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75b71d6-a2c8-4217-ba57-80533d555784" containerName="registry-server"
Jul 20 13:45:47.414918 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.414797    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75b71d6-a2c8-4217-ba57-80533d555784" containerName="registry-server"
Jul 20 13:45:47.417382 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.417365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:45:47.420557 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.420532    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-d8x55\""
Jul 20 13:45:47.431883 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.431852    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"]
Jul 20 13:45:47.562806 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.562770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4zsh\" (UniqueName: \"kubernetes.io/projected/127bdbef-ef01-4e50-b779-7ba743dd43a4-kube-api-access-d4zsh\") pod \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" (UID: \"127bdbef-ef01-4e50-b779-7ba743dd43a4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:45:47.664068 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.664028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4zsh\" (UniqueName: \"kubernetes.io/projected/127bdbef-ef01-4e50-b779-7ba743dd43a4-kube-api-access-d4zsh\") pod \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" (UID: \"127bdbef-ef01-4e50-b779-7ba743dd43a4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:45:47.674275 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.674211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4zsh\" (UniqueName: \"kubernetes.io/projected/127bdbef-ef01-4e50-b779-7ba743dd43a4-kube-api-access-d4zsh\") pod \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" (UID: \"127bdbef-ef01-4e50-b779-7ba743dd43a4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:45:47.728150 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.728109    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:45:47.867075 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:47.867052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"]
Jul 20 13:45:47.869423 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:45:47.869397    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127bdbef_ef01_4e50_b779_7ba743dd43a4.slice/crio-3585ba1ab4b5d448ee703d7e682cc8ea9e1a59777facc17250fdcd92885ada65 WatchSource:0}: Error finding container 3585ba1ab4b5d448ee703d7e682cc8ea9e1a59777facc17250fdcd92885ada65: Status 404 returned error can't find the container with id 3585ba1ab4b5d448ee703d7e682cc8ea9e1a59777facc17250fdcd92885ada65
Jul 20 13:45:48.243865 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:48.243828    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc" event={"ID":"127bdbef-ef01-4e50-b779-7ba743dd43a4","Type":"ContainerStarted","Data":"3585ba1ab4b5d448ee703d7e682cc8ea9e1a59777facc17250fdcd92885ada65"}
Jul 20 13:45:50.255109 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.255070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc" event={"ID":"127bdbef-ef01-4e50-b779-7ba743dd43a4","Type":"ContainerStarted","Data":"0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee"}
Jul 20 13:45:50.255596 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.255137    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:45:50.281623 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.281564    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc" podStartSLOduration=1.6833616519999999 podStartE2EDuration="3.281542194s" totalImagesPullingTime="1.598180542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:50.280785486 +0000 UTC m=+455.556030017" watchObservedRunningTime="2026-07-20 13:45:50.281542194 +0000 UTC m=+455.556786723"
Jul 20 13:45:50.766619 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.766580    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"]
Jul 20 13:45:50.770233 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.770208    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:45:50.772802 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.772773    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 13:45:50.772949 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.772803    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cx4mc\""
Jul 20 13:45:50.780248 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.780223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"]
Jul 20 13:45:50.895540 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.895506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgc9\" (UniqueName: \"kubernetes.io/projected/33c4d463-7131-403d-aef5-8d84c878838a-kube-api-access-vxgc9\") pod \"dns-operator-controller-manager-864dd78c4c-8nmjc\" (UID: \"33c4d463-7131-403d-aef5-8d84c878838a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:45:50.996279 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:50.996237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgc9\" (UniqueName: \"kubernetes.io/projected/33c4d463-7131-403d-aef5-8d84c878838a-kube-api-access-vxgc9\") pod \"dns-operator-controller-manager-864dd78c4c-8nmjc\" (UID: \"33c4d463-7131-403d-aef5-8d84c878838a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:45:51.008482 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:51.008450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgc9\" (UniqueName: \"kubernetes.io/projected/33c4d463-7131-403d-aef5-8d84c878838a-kube-api-access-vxgc9\") pod \"dns-operator-controller-manager-864dd78c4c-8nmjc\" (UID: \"33c4d463-7131-403d-aef5-8d84c878838a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:45:51.081524 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:51.081439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:45:51.231817 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:51.231785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"]
Jul 20 13:45:51.236241 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:45:51.236210    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c4d463_7131_403d_aef5_8d84c878838a.slice/crio-4e7489211369b57a095da8ae6f0887ae5b62a23286aa1bee4f16d7e5f5c964ea WatchSource:0}: Error finding container 4e7489211369b57a095da8ae6f0887ae5b62a23286aa1bee4f16d7e5f5c964ea: Status 404 returned error can't find the container with id 4e7489211369b57a095da8ae6f0887ae5b62a23286aa1bee4f16d7e5f5c964ea
Jul 20 13:45:51.261448 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:51.261408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc" event={"ID":"33c4d463-7131-403d-aef5-8d84c878838a","Type":"ContainerStarted","Data":"4e7489211369b57a095da8ae6f0887ae5b62a23286aa1bee4f16d7e5f5c964ea"}
Jul 20 13:45:53.274331 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:53.274293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc" event={"ID":"33c4d463-7131-403d-aef5-8d84c878838a","Type":"ContainerStarted","Data":"f95750fcccbc8cc9c148fd5957559e1778a67999ced7f247a4220aef96ec381a"}
Jul 20 13:45:53.274826 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:53.274538    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:45:53.292266 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:53.292212    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc" podStartSLOduration=1.415330562 podStartE2EDuration="3.292194209s" totalImagesPullingTime="1.876863647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:53.290704327 +0000 UTC m=+458.565948860" watchObservedRunningTime="2026-07-20 13:45:53.292194209 +0000 UTC m=+458.567438737"
Jul 20 13:45:55.740383 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:55.740345    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"]
Jul 20 13:45:55.743831 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:55.743813    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:55.747028 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:55.747010    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7r46h\""
Jul 20 13:45:55.771548 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:55.771511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"]
Jul 20 13:45:55.938648 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:55.938605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvvc6\" (UniqueName: \"kubernetes.io/projected/a42186b7-6987-4a7c-9bb8-9f85911f0587-kube-api-access-pvvc6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:55.938857 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:55.938750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a42186b7-6987-4a7c-9bb8-9f85911f0587-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:56.039531 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.039447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvvc6\" (UniqueName: \"kubernetes.io/projected/a42186b7-6987-4a7c-9bb8-9f85911f0587-kube-api-access-pvvc6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:56.039704 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.039542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a42186b7-6987-4a7c-9bb8-9f85911f0587-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:56.039951 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.039928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a42186b7-6987-4a7c-9bb8-9f85911f0587-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:56.049613 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.049587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvvc6\" (UniqueName: \"kubernetes.io/projected/a42186b7-6987-4a7c-9bb8-9f85911f0587-kube-api-access-pvvc6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:56.054365 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.054345    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:45:56.207978 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.207941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"]
Jul 20 13:45:56.211736 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:45:56.211711    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42186b7_6987_4a7c_9bb8_9f85911f0587.slice/crio-d8541fb4b67f09b4a77b16c327c1d0d8be2b14403bd4f29d576794550388cf15 WatchSource:0}: Error finding container d8541fb4b67f09b4a77b16c327c1d0d8be2b14403bd4f29d576794550388cf15: Status 404 returned error can't find the container with id d8541fb4b67f09b4a77b16c327c1d0d8be2b14403bd4f29d576794550388cf15
Jul 20 13:45:56.289132 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:56.289095    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865" event={"ID":"a42186b7-6987-4a7c-9bb8-9f85911f0587","Type":"ContainerStarted","Data":"d8541fb4b67f09b4a77b16c327c1d0d8be2b14403bd4f29d576794550388cf15"}
Jul 20 13:45:59.569828 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.569787    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"]
Jul 20 13:45:59.573616 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.573591    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:45:59.576609 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.576585    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6cjmj\""
Jul 20 13:45:59.587063 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.587036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"]
Jul 20 13:45:59.668906 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.668864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82wb\" (UniqueName: \"kubernetes.io/projected/d1820ba4-79f2-4529-84ae-0cd445536f20-kube-api-access-r82wb\") pod \"authorino-operator-75cc8d5cb7-9lrv8\" (UID: \"d1820ba4-79f2-4529-84ae-0cd445536f20\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:45:59.769516 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.769456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r82wb\" (UniqueName: \"kubernetes.io/projected/d1820ba4-79f2-4529-84ae-0cd445536f20-kube-api-access-r82wb\") pod \"authorino-operator-75cc8d5cb7-9lrv8\" (UID: \"d1820ba4-79f2-4529-84ae-0cd445536f20\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:45:59.779673 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.779637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82wb\" (UniqueName: \"kubernetes.io/projected/d1820ba4-79f2-4529-84ae-0cd445536f20-kube-api-access-r82wb\") pod \"authorino-operator-75cc8d5cb7-9lrv8\" (UID: \"d1820ba4-79f2-4529-84ae-0cd445536f20\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:45:59.887249 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:45:59.887140    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:46:00.767152 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:00.767125    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"]
Jul 20 13:46:00.770223 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:46:00.770194    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1820ba4_79f2_4529_84ae_0cd445536f20.slice/crio-8ed88444e9cf059dc1f277db29ef4b0e1f162a415013ac1f581807286e2e1c55 WatchSource:0}: Error finding container 8ed88444e9cf059dc1f277db29ef4b0e1f162a415013ac1f581807286e2e1c55: Status 404 returned error can't find the container with id 8ed88444e9cf059dc1f277db29ef4b0e1f162a415013ac1f581807286e2e1c55
Jul 20 13:46:01.264516 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:01.264487    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:01.322235 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:01.322198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8" event={"ID":"d1820ba4-79f2-4529-84ae-0cd445536f20","Type":"ContainerStarted","Data":"8ed88444e9cf059dc1f277db29ef4b0e1f162a415013ac1f581807286e2e1c55"}
Jul 20 13:46:01.324029 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:01.323998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865" event={"ID":"a42186b7-6987-4a7c-9bb8-9f85911f0587","Type":"ContainerStarted","Data":"eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14"}
Jul 20 13:46:01.324282 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:01.324262    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:01.344195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:01.344100    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865" podStartSLOduration=1.870154791 podStartE2EDuration="6.344080027s" totalImagesPullingTime="4.473925236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:01.342450833 +0000 UTC m=+466.617695363" watchObservedRunningTime="2026-07-20 13:46:01.344080027 +0000 UTC m=+466.619324557"
Jul 20 13:46:03.336685 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.336593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8" event={"ID":"d1820ba4-79f2-4529-84ae-0cd445536f20","Type":"ContainerStarted","Data":"48429a8c4d6687159d04baaca0e20aabcec65b73ade378b63bbf7d2f370b4f0c"}
Jul 20 13:46:03.337063 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.336736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:46:03.355309 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.355254    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8" podStartSLOduration=2.116809543 podStartE2EDuration="4.355236141s" totalImagesPullingTime="2.238426598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:03.35354238 +0000 UTC m=+468.628786910" watchObservedRunningTime="2026-07-20 13:46:03.355236141 +0000 UTC m=+468.630480669"
Jul 20 13:46:03.824785 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.824750    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"]
Jul 20 13:46:03.828220 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.828198    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.830766 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.830740    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 20 13:46:03.830905 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.830749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bg7tx\""
Jul 20 13:46:03.830905 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.830749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 20 13:46:03.836814 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.836786    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"]
Jul 20 13:46:03.897831 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.897795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.897989 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.897845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tbm\" (UniqueName: \"kubernetes.io/projected/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-kube-api-access-g4tbm\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.897989 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.897929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.998720 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.998683    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.998898 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.998736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.998898 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.998765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tbm\" (UniqueName: \"kubernetes.io/projected/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-kube-api-access-g4tbm\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:03.998898 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:03.998857    2559 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 20 13:46:03.999079 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:03.998936    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-plugin-serving-cert podName:1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc nodeName:}" failed. No retries permitted until 2026-07-20 13:46:04.498914098 +0000 UTC m=+469.774158641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2k95k" (UID: "1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc") : secret "plugin-serving-cert" not found
Jul 20 13:46:03.999426 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:03.999408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:04.007338 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:04.007304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tbm\" (UniqueName: \"kubernetes.io/projected/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-kube-api-access-g4tbm\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:04.281562 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:04.281528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8nmjc"
Jul 20 13:46:04.503874 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:04.503831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:04.506395 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:04.506373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k95k\" (UID: \"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:04.738318 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:04.738270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"
Jul 20 13:46:04.910577 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:04.910551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k"]
Jul 20 13:46:04.912891 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:46:04.912840    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e0cebc5_c8cc_440e_ab8c_1e043e9b93bc.slice/crio-a699fca15c877398a191b95f379b3b201cad135a64f2193de47c467fdbe12067 WatchSource:0}: Error finding container a699fca15c877398a191b95f379b3b201cad135a64f2193de47c467fdbe12067: Status 404 returned error can't find the container with id a699fca15c877398a191b95f379b3b201cad135a64f2193de47c467fdbe12067
Jul 20 13:46:05.348706 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:05.348669    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k" event={"ID":"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc","Type":"ContainerStarted","Data":"a699fca15c877398a191b95f379b3b201cad135a64f2193de47c467fdbe12067"}
Jul 20 13:46:12.333911 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:12.333872    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:14.116928 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.116889    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"]
Jul 20 13:46:14.117444 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.117138    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" containerName="manager" containerID="cri-o://eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14" gracePeriod=2
Jul 20 13:46:14.132978 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.132942    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"]
Jul 20 13:46:14.142443 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.142394    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a42186b7-6987-4a7c-9bb8-9f85911f0587\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lc865\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:14.143480 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.142950    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"]
Jul 20 13:46:14.143480 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.143493    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" containerName="manager"
Jul 20 13:46:14.143712 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.143512    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" containerName="manager"
Jul 20 13:46:14.143712 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.143606    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" containerName="manager"
Jul 20 13:46:14.162716 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.162682    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"]
Jul 20 13:46:14.162906 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.162742    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"]
Jul 20 13:46:14.162975 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.162937    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" containerName="manager" containerID="cri-o://0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee" gracePeriod=2
Jul 20 13:46:14.163195 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.163151    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.164979 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.164782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"]
Jul 20 13:46:14.165696 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.165657    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:14.185410 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.185373    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"]
Jul 20 13:46:14.185992 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.185955    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" containerName="manager"
Jul 20 13:46:14.185992 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.185981    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" containerName="manager"
Jul 20 13:46:14.186212 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.186079    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" containerName="manager"
Jul 20 13:46:14.190357 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.190106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:14.194425 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.194382    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:14.196883 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.196855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cr5k\" (UniqueName: \"kubernetes.io/projected/270f80a0-1c0a-4d09-bd73-2f106884ff66-kube-api-access-5cr5k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btb6b\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.197020 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.196960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/270f80a0-1c0a-4d09-bd73-2f106884ff66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btb6b\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.197232 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.197207    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:14.208349 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.208000    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"]
Jul 20 13:46:14.227443 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.227391    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:14.298710 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.298464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/270f80a0-1c0a-4d09-bd73-2f106884ff66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btb6b\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.298710 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.298573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cr5k\" (UniqueName: \"kubernetes.io/projected/270f80a0-1c0a-4d09-bd73-2f106884ff66-kube-api-access-5cr5k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btb6b\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.298710 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.298665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtb47\" (UniqueName: \"kubernetes.io/projected/6c01140d-bccc-4d2c-9803-2946be98ee3d-kube-api-access-mtb47\") pod \"limitador-operator-controller-manager-859d7b78bd-trzn7\" (UID: \"6c01140d-bccc-4d2c-9803-2946be98ee3d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:14.299494 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.299459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/270f80a0-1c0a-4d09-bd73-2f106884ff66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btb6b\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.310650 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.310613    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cr5k\" (UniqueName: \"kubernetes.io/projected/270f80a0-1c0a-4d09-bd73-2f106884ff66-kube-api-access-5cr5k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btb6b\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.345452 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.345417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9lrv8"
Jul 20 13:46:14.365221 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.365145    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:14.367013 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:14.366925    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:14.399603 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.399560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtb47\" (UniqueName: \"kubernetes.io/projected/6c01140d-bccc-4d2c-9803-2946be98ee3d-kube-api-access-mtb47\") pod \"limitador-operator-controller-manager-859d7b78bd-trzn7\" (UID: \"6c01140d-bccc-4d2c-9803-2946be98ee3d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:14.415878 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.415845    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtb47\" (UniqueName: \"kubernetes.io/projected/6c01140d-bccc-4d2c-9803-2946be98ee3d-kube-api-access-mtb47\") pod \"limitador-operator-controller-manager-859d7b78bd-trzn7\" (UID: \"6c01140d-bccc-4d2c-9803-2946be98ee3d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:14.564952 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.564911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:14.572636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:14.572595    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:15.193456 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:15.193415    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:15.195994 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:15.195955    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.375477 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.375448    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.378118 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.378068    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.379633 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.379608    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.380206 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.380184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"]
Jul 20 13:46:26.381362 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.381333    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.382863 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:46:26.382829    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270f80a0_1c0a_4d09_bd73_2f106884ff66.slice/crio-6b60fa0c434b3c5ca1f1fead1bfdcbd20391728d06400e8859ee56b08e38de5e WatchSource:0}: Error finding container 6b60fa0c434b3c5ca1f1fead1bfdcbd20391728d06400e8859ee56b08e38de5e: Status 404 returned error can't find the container with id 6b60fa0c434b3c5ca1f1fead1bfdcbd20391728d06400e8859ee56b08e38de5e
Jul 20 13:46:26.383237 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.383203    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.406592 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.406373    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"]
Jul 20 13:46:26.417367 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:46:26.417331    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c01140d_bccc_4d2c_9803_2946be98ee3d.slice/crio-d3b29601a914dcaa1fb198c5e9a16a3ffc972268b4d33263e2753039d717e0ea WatchSource:0}: Error finding container d3b29601a914dcaa1fb198c5e9a16a3ffc972268b4d33263e2753039d717e0ea: Status 404 returned error can't find the container with id d3b29601a914dcaa1fb198c5e9a16a3ffc972268b4d33263e2753039d717e0ea
Jul 20 13:46:26.466080 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.466046    2559 generic.go:356] "Generic (PLEG): container finished" podID="a42186b7-6987-4a7c-9bb8-9f85911f0587" containerID="eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14" exitCode=0
Jul 20 13:46:26.466249 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.466092    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.466249 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.466142    2559 scope.go:117] "RemoveContainer" containerID="eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14"
Jul 20 13:46:26.467380 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.467358    2559 generic.go:356] "Generic (PLEG): container finished" podID="127bdbef-ef01-4e50-b779-7ba743dd43a4" containerID="0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee" exitCode=0
Jul 20 13:46:26.467473 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.467398    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.468398 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.468372    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.468734 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.468714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7" event={"ID":"6c01140d-bccc-4d2c-9803-2946be98ee3d","Type":"ContainerStarted","Data":"d3b29601a914dcaa1fb198c5e9a16a3ffc972268b4d33263e2753039d717e0ea"}
Jul 20 13:46:26.470101 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.470072    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.470237 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.470189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k" event={"ID":"1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc","Type":"ContainerStarted","Data":"f06c3c769fd049a3aba3a8fa48c39ff8e43158a34fa27f4d86e2e0e7fa40cfb5"}
Jul 20 13:46:26.471704 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.471682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b" event={"ID":"270f80a0-1c0a-4d09-bd73-2f106884ff66","Type":"ContainerStarted","Data":"c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f"}
Jul 20 13:46:26.471807 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.471729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b" event={"ID":"270f80a0-1c0a-4d09-bd73-2f106884ff66","Type":"ContainerStarted","Data":"6b60fa0c434b3c5ca1f1fead1bfdcbd20391728d06400e8859ee56b08e38de5e"}
Jul 20 13:46:26.471807 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.471751    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:26.471922 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.471888    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.473705 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.473513    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.478903 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.478779    2559 scope.go:117] "RemoveContainer" containerID="eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14"
Jul 20 13:46:26.479122 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.479090    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14\": container with ID starting with eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14 not found: ID does not exist" containerID="eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14"
Jul 20 13:46:26.479246 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.479129    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14"} err="failed to get container status \"eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14\": rpc error: code = NotFound desc = could not find container \"eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14\": container with ID starting with eb53bba4990c4bfb02bdfe5d86bbb7c3eaf466cb97a80c67e0ce8883129d1f14 not found: ID does not exist"
Jul 20 13:46:26.479246 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.479149    2559 scope.go:117] "RemoveContainer" containerID="0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee"
Jul 20 13:46:26.488262 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.488241    2559 scope.go:117] "RemoveContainer" containerID="0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee"
Jul 20 13:46:26.488712 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.488635    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee\": container with ID starting with 0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee not found: ID does not exist" containerID="0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee"
Jul 20 13:46:26.488712 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.488689    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee"} err="failed to get container status \"0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee\": rpc error: code = NotFound desc = could not find container \"0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee\": container with ID starting with 0de2640d0529b8c7d940229a3b53202856d26a50152c6db2c3dc089ef5a635ee not found: ID does not exist"
Jul 20 13:46:26.490265 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.490149    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k95k" podStartSLOduration=2.11405592 podStartE2EDuration="23.490130566s" totalImagesPullingTime="21.376074646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:26.488553081 +0000 UTC m=+491.763797614" watchObservedRunningTime="2026-07-20 13:46:26.490130566 +0000 UTC m=+491.765375096"
Jul 20 13:46:26.490399 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.490368    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.508502 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.508312    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b" podStartSLOduration=12.508291121 podStartE2EDuration="12.508291121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:26.506540091 +0000 UTC m=+491.781784622" watchObservedRunningTime="2026-07-20 13:46:26.508291121 +0000 UTC m=+491.783535651"
Jul 20 13:46:26.508502 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.508448    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.512553 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.512468    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvvc6\" (UniqueName: \"kubernetes.io/projected/a42186b7-6987-4a7c-9bb8-9f85911f0587-kube-api-access-pvvc6\") pod \"a42186b7-6987-4a7c-9bb8-9f85911f0587\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") "
Jul 20 13:46:26.512553 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.512507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a42186b7-6987-4a7c-9bb8-9f85911f0587-extensions-socket-volume\") pod \"a42186b7-6987-4a7c-9bb8-9f85911f0587\" (UID: \"a42186b7-6987-4a7c-9bb8-9f85911f0587\") "
Jul 20 13:46:26.512791 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.512563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4zsh\" (UniqueName: \"kubernetes.io/projected/127bdbef-ef01-4e50-b779-7ba743dd43a4-kube-api-access-d4zsh\") pod \"127bdbef-ef01-4e50-b779-7ba743dd43a4\" (UID: \"127bdbef-ef01-4e50-b779-7ba743dd43a4\") "
Jul 20 13:46:26.513130 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.513104    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42186b7-6987-4a7c-9bb8-9f85911f0587-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a42186b7-6987-4a7c-9bb8-9f85911f0587" (UID: "a42186b7-6987-4a7c-9bb8-9f85911f0587"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:46:26.515469 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.515434    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127bdbef-ef01-4e50-b779-7ba743dd43a4-kube-api-access-d4zsh" (OuterVolumeSpecName: "kube-api-access-d4zsh") pod "127bdbef-ef01-4e50-b779-7ba743dd43a4" (UID: "127bdbef-ef01-4e50-b779-7ba743dd43a4"). InnerVolumeSpecName "kube-api-access-d4zsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:46:26.515553 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.515481    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42186b7-6987-4a7c-9bb8-9f85911f0587-kube-api-access-pvvc6" (OuterVolumeSpecName: "kube-api-access-pvvc6") pod "a42186b7-6987-4a7c-9bb8-9f85911f0587" (UID: "a42186b7-6987-4a7c-9bb8-9f85911f0587"). InnerVolumeSpecName "kube-api-access-pvvc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:46:26.614417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.614373    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvvc6\" (UniqueName: \"kubernetes.io/projected/a42186b7-6987-4a7c-9bb8-9f85911f0587-kube-api-access-pvvc6\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:46:26.614417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.614411    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a42186b7-6987-4a7c-9bb8-9f85911f0587-extensions-socket-volume\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:46:26.614417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:26.614427    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4zsh\" (UniqueName: \"kubernetes.io/projected/127bdbef-ef01-4e50-b779-7ba743dd43a4-kube-api-access-d4zsh\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:46:26.780363 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.780331    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:26.782063 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.782039    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.783672 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.783641    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dmpdc\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dmpdc"
Jul 20 13:46:26.785395 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:26.785373    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lc865\" is forbidden: User \"system:node:ip-10-0-131-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-139.ec2.internal' and this object" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lc865"
Jul 20 13:46:27.194284 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:27.194250    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127bdbef-ef01-4e50-b779-7ba743dd43a4" path="/var/lib/kubelet/pods/127bdbef-ef01-4e50-b779-7ba743dd43a4/volumes"
Jul 20 13:46:27.197928 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:27.197881    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42186b7-6987-4a7c-9bb8-9f85911f0587" path="/var/lib/kubelet/pods/a42186b7-6987-4a7c-9bb8-9f85911f0587/volumes"
Jul 20 13:46:27.479945 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:27.479838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7" event={"ID":"6c01140d-bccc-4d2c-9803-2946be98ee3d","Type":"ContainerStarted","Data":"3dbc26f3e1b185dc0e2422bd5e46d4220fcd36f97b7700efde3c04efdfd69eae"}
Jul 20 13:46:27.480451 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:27.480126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:27.496810 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:27.496759    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7" podStartSLOduration=13.496741329 podStartE2EDuration="13.496741329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:27.496181932 +0000 UTC m=+492.771426455" watchObservedRunningTime="2026-07-20 13:46:27.496741329 +0000 UTC m=+492.771985913"
Jul 20 13:46:29.659400 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.659365    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"]
Jul 20 13:46:29.659910 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.659575    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b" podUID="270f80a0-1c0a-4d09-bd73-2f106884ff66" containerName="manager" containerID="cri-o://c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f" gracePeriod=10
Jul 20 13:46:29.915696 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.915626    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:29.964000 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.963958    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"]
Jul 20 13:46:29.964341 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.964326    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270f80a0-1c0a-4d09-bd73-2f106884ff66" containerName="manager"
Jul 20 13:46:29.964341 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.964342    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="270f80a0-1c0a-4d09-bd73-2f106884ff66" containerName="manager"
Jul 20 13:46:29.964502 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.964415    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="270f80a0-1c0a-4d09-bd73-2f106884ff66" containerName="manager"
Jul 20 13:46:29.968054 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.968028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:29.982144 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:29.982114    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"]
Jul 20 13:46:30.045013 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.044978    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/270f80a0-1c0a-4d09-bd73-2f106884ff66-extensions-socket-volume\") pod \"270f80a0-1c0a-4d09-bd73-2f106884ff66\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") "
Jul 20 13:46:30.045013 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.045022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cr5k\" (UniqueName: \"kubernetes.io/projected/270f80a0-1c0a-4d09-bd73-2f106884ff66-kube-api-access-5cr5k\") pod \"270f80a0-1c0a-4d09-bd73-2f106884ff66\" (UID: \"270f80a0-1c0a-4d09-bd73-2f106884ff66\") "
Jul 20 13:46:30.045305 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.045285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/defe6644-fa9b-4b2e-a968-9c293c3755d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-szhmn\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.045375 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.045362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rw5\" (UniqueName: \"kubernetes.io/projected/defe6644-fa9b-4b2e-a968-9c293c3755d2-kube-api-access-v6rw5\") pod \"kuadrant-operator-controller-manager-86878c769f-szhmn\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.045452 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.045428    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/270f80a0-1c0a-4d09-bd73-2f106884ff66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "270f80a0-1c0a-4d09-bd73-2f106884ff66" (UID: "270f80a0-1c0a-4d09-bd73-2f106884ff66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:46:30.047372 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.047352    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/270f80a0-1c0a-4d09-bd73-2f106884ff66-kube-api-access-5cr5k" (OuterVolumeSpecName: "kube-api-access-5cr5k") pod "270f80a0-1c0a-4d09-bd73-2f106884ff66" (UID: "270f80a0-1c0a-4d09-bd73-2f106884ff66"). InnerVolumeSpecName "kube-api-access-5cr5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:46:30.145925 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.145882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/defe6644-fa9b-4b2e-a968-9c293c3755d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-szhmn\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.146124 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.145970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rw5\" (UniqueName: \"kubernetes.io/projected/defe6644-fa9b-4b2e-a968-9c293c3755d2-kube-api-access-v6rw5\") pod \"kuadrant-operator-controller-manager-86878c769f-szhmn\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.146124 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.146040    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/270f80a0-1c0a-4d09-bd73-2f106884ff66-extensions-socket-volume\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:46:30.146124 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.146055    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cr5k\" (UniqueName: \"kubernetes.io/projected/270f80a0-1c0a-4d09-bd73-2f106884ff66-kube-api-access-5cr5k\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:46:30.146327 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.146307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/defe6644-fa9b-4b2e-a968-9c293c3755d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-szhmn\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.156079 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.156055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rw5\" (UniqueName: \"kubernetes.io/projected/defe6644-fa9b-4b2e-a968-9c293c3755d2-kube-api-access-v6rw5\") pod \"kuadrant-operator-controller-manager-86878c769f-szhmn\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.279809 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.279716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.426291 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.426264    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"]
Jul 20 13:46:30.429019 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:46:30.428994    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefe6644_fa9b_4b2e_a968_9c293c3755d2.slice/crio-8306ed00263f6ba0248f47160b33fcd0b4bf8a193a6e43b251659adab5124614 WatchSource:0}: Error finding container 8306ed00263f6ba0248f47160b33fcd0b4bf8a193a6e43b251659adab5124614: Status 404 returned error can't find the container with id 8306ed00263f6ba0248f47160b33fcd0b4bf8a193a6e43b251659adab5124614
Jul 20 13:46:30.495558 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.495518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn" event={"ID":"defe6644-fa9b-4b2e-a968-9c293c3755d2","Type":"ContainerStarted","Data":"9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f"}
Jul 20 13:46:30.495719 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.495580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn" event={"ID":"defe6644-fa9b-4b2e-a968-9c293c3755d2","Type":"ContainerStarted","Data":"8306ed00263f6ba0248f47160b33fcd0b4bf8a193a6e43b251659adab5124614"}
Jul 20 13:46:30.495719 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.495625    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:30.497261 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.497226    2559 generic.go:356] "Generic (PLEG): container finished" podID="270f80a0-1c0a-4d09-bd73-2f106884ff66" containerID="c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f" exitCode=0
Jul 20 13:46:30.497261 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.497257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b" event={"ID":"270f80a0-1c0a-4d09-bd73-2f106884ff66","Type":"ContainerDied","Data":"c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f"}
Jul 20 13:46:30.497423 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.497269    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"
Jul 20 13:46:30.497423 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.497286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b" event={"ID":"270f80a0-1c0a-4d09-bd73-2f106884ff66","Type":"ContainerDied","Data":"6b60fa0c434b3c5ca1f1fead1bfdcbd20391728d06400e8859ee56b08e38de5e"}
Jul 20 13:46:30.497423 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.497309    2559 scope.go:117] "RemoveContainer" containerID="c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f"
Jul 20 13:46:30.506324 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.506303    2559 scope.go:117] "RemoveContainer" containerID="c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f"
Jul 20 13:46:30.506613 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:46:30.506596    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f\": container with ID starting with c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f not found: ID does not exist" containerID="c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f"
Jul 20 13:46:30.506676 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.506623    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f"} err="failed to get container status \"c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f\": rpc error: code = NotFound desc = could not find container \"c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f\": container with ID starting with c1fb712fd61881eb55bdb91c7729c8e0ee002f52f640382fd91c409819742b2f not found: ID does not exist"
Jul 20 13:46:30.521079 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.521032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn" podStartSLOduration=1.5210163479999999 podStartE2EDuration="1.521016348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:30.519749254 +0000 UTC m=+495.794993785" watchObservedRunningTime="2026-07-20 13:46:30.521016348 +0000 UTC m=+495.796260949"
Jul 20 13:46:30.536943 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.536854    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"]
Jul 20 13:46:30.542062 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:30.542035    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btb6b"]
Jul 20 13:46:31.192227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:31.192180    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270f80a0-1c0a-4d09-bd73-2f106884ff66" path="/var/lib/kubelet/pods/270f80a0-1c0a-4d09-bd73-2f106884ff66/volumes"
Jul 20 13:46:38.487084 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:38.487055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trzn7"
Jul 20 13:46:41.506125 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:41.506094    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:46:46.078866 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.078827    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"]
Jul 20 13:46:46.207570 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.207535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"]
Jul 20 13:46:46.207739 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.207649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.210055 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.210033    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gjttd\""
Jul 20 13:46:46.390905 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.390808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.390905 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.390880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.390939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.390989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51584f-d956-43e0-bcf3-194540f5aae5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.391031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.391055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.391120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391154 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.391144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzr6n\" (UniqueName: \"kubernetes.io/projected/bc51584f-d956-43e0-bcf3-194540f5aae5-kube-api-access-dzr6n\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.391514 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.391266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492760 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51584f-d956-43e0-bcf3-194540f5aae5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzr6n\" (UniqueName: \"kubernetes.io/projected/bc51584f-d956-43e0-bcf3-194540f5aae5-kube-api-access-dzr6n\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.492962 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493323 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.492980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493323 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.493012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493435 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.493357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493435 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.493426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493547 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.493511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493643 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.493619    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.493901 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.493627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51584f-d956-43e0-bcf3-194540f5aae5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.495509 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.495483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.495686 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.495669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.502022 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.502001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzr6n\" (UniqueName: \"kubernetes.io/projected/bc51584f-d956-43e0-bcf3-194540f5aae5-kube-api-access-dzr6n\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.502131 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.502041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51584f-d956-43e0-bcf3-194540f5aae5-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gwrc7\" (UID: \"bc51584f-d956-43e0-bcf3-194540f5aae5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.519012 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.518976    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:46.685847 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.685821    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"]
Jul 20 13:46:46.688572 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:46:46.688538    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc51584f_d956_43e0_bcf3_194540f5aae5.slice/crio-d9954bc3c407188e3bacf057e74cf18a373a1a8c72b245252722c60d1f28fde3 WatchSource:0}: Error finding container d9954bc3c407188e3bacf057e74cf18a373a1a8c72b245252722c60d1f28fde3: Status 404 returned error can't find the container with id d9954bc3c407188e3bacf057e74cf18a373a1a8c72b245252722c60d1f28fde3
Jul 20 13:46:46.690603 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.690564    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:46:46.690707 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.690638    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:46:46.690707 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:46.690669    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:46:47.585014 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:47.584976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" event={"ID":"bc51584f-d956-43e0-bcf3-194540f5aae5","Type":"ContainerStarted","Data":"4912978ea222895a23dad46a6602dbd861cc0aa8c682c7012402b8f17092b767"}
Jul 20 13:46:47.585545 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:47.585037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" event={"ID":"bc51584f-d956-43e0-bcf3-194540f5aae5","Type":"ContainerStarted","Data":"d9954bc3c407188e3bacf057e74cf18a373a1a8c72b245252722c60d1f28fde3"}
Jul 20 13:46:47.611673 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:47.611614    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" podStartSLOduration=1.611594716 podStartE2EDuration="1.611594716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:47.610294099 +0000 UTC m=+512.885538631" watchObservedRunningTime="2026-07-20 13:46:47.611594716 +0000 UTC m=+512.886839247"
Jul 20 13:46:48.520041 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:48.520000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:48.525189 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:48.525129    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:48.590753 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:48.590715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:46:48.591715 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:46:48.591695    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:47:02.640926 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.640883    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-b2mbf"]
Jul 20 13:47:02.709137 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.709095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2mbf"]
Jul 20 13:47:02.709365 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.709250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:02.711891 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.711866    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-45rxl\""
Jul 20 13:47:02.822502 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.822466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g5j8\" (UniqueName: \"kubernetes.io/projected/2b8c1848-9dc0-400a-8ffc-a99a8b64de75-kube-api-access-5g5j8\") pod \"authorino-58cd955675-b2mbf\" (UID: \"2b8c1848-9dc0-400a-8ffc-a99a8b64de75\") " pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:02.923346 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.923300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g5j8\" (UniqueName: \"kubernetes.io/projected/2b8c1848-9dc0-400a-8ffc-a99a8b64de75-kube-api-access-5g5j8\") pod \"authorino-58cd955675-b2mbf\" (UID: \"2b8c1848-9dc0-400a-8ffc-a99a8b64de75\") " pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:02.931737 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:02.931702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g5j8\" (UniqueName: \"kubernetes.io/projected/2b8c1848-9dc0-400a-8ffc-a99a8b64de75-kube-api-access-5g5j8\") pod \"authorino-58cd955675-b2mbf\" (UID: \"2b8c1848-9dc0-400a-8ffc-a99a8b64de75\") " pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:03.019926 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:03.019889    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:03.168179 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:03.168129    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2mbf"]
Jul 20 13:47:03.171670 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:47:03.171638    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b8c1848_9dc0_400a_8ffc_a99a8b64de75.slice/crio-02c830cc6eb52d0839e419e5f237646ff963d2bd4d7acda37e423e1733f5384b WatchSource:0}: Error finding container 02c830cc6eb52d0839e419e5f237646ff963d2bd4d7acda37e423e1733f5384b: Status 404 returned error can't find the container with id 02c830cc6eb52d0839e419e5f237646ff963d2bd4d7acda37e423e1733f5384b
Jul 20 13:47:03.666610 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:03.666578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2mbf" event={"ID":"2b8c1848-9dc0-400a-8ffc-a99a8b64de75","Type":"ContainerStarted","Data":"02c830cc6eb52d0839e419e5f237646ff963d2bd4d7acda37e423e1733f5384b"}
Jul 20 13:47:06.685577 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:06.685475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2mbf" event={"ID":"2b8c1848-9dc0-400a-8ffc-a99a8b64de75","Type":"ContainerStarted","Data":"2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca"}
Jul 20 13:47:06.703393 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:06.703335    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-b2mbf" podStartSLOduration=1.445795166 podStartE2EDuration="4.703317622s" totalImagesPullingTime="3.257522456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:47:06.701537606 +0000 UTC m=+531.976782147" watchObservedRunningTime="2026-07-20 13:47:06.703317622 +0000 UTC m=+531.978562151"
Jul 20 13:47:07.451508 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:07.451469    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2mbf"]
Jul 20 13:47:08.695032 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:08.694991    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-b2mbf" podUID="2b8c1848-9dc0-400a-8ffc-a99a8b64de75" containerName="authorino" containerID="cri-o://2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca" gracePeriod=30
Jul 20 13:47:08.954744 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:08.954679    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:09.082895 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.082860    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g5j8\" (UniqueName: \"kubernetes.io/projected/2b8c1848-9dc0-400a-8ffc-a99a8b64de75-kube-api-access-5g5j8\") pod \"2b8c1848-9dc0-400a-8ffc-a99a8b64de75\" (UID: \"2b8c1848-9dc0-400a-8ffc-a99a8b64de75\") "
Jul 20 13:47:09.085153 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.085111    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b8c1848-9dc0-400a-8ffc-a99a8b64de75-kube-api-access-5g5j8" (OuterVolumeSpecName: "kube-api-access-5g5j8") pod "2b8c1848-9dc0-400a-8ffc-a99a8b64de75" (UID: "2b8c1848-9dc0-400a-8ffc-a99a8b64de75"). InnerVolumeSpecName "kube-api-access-5g5j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:09.183738 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.183697    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g5j8\" (UniqueName: \"kubernetes.io/projected/2b8c1848-9dc0-400a-8ffc-a99a8b64de75-kube-api-access-5g5j8\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:47:09.701717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.701686    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b8c1848-9dc0-400a-8ffc-a99a8b64de75" containerID="2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca" exitCode=0
Jul 20 13:47:09.702240 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.701760    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2mbf" event={"ID":"2b8c1848-9dc0-400a-8ffc-a99a8b64de75","Type":"ContainerDied","Data":"2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca"}
Jul 20 13:47:09.702240 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.701785    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2mbf"
Jul 20 13:47:09.702240 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.701805    2559 scope.go:117] "RemoveContainer" containerID="2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca"
Jul 20 13:47:09.702240 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.701789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2mbf" event={"ID":"2b8c1848-9dc0-400a-8ffc-a99a8b64de75","Type":"ContainerDied","Data":"02c830cc6eb52d0839e419e5f237646ff963d2bd4d7acda37e423e1733f5384b"}
Jul 20 13:47:09.710461 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.710445    2559 scope.go:117] "RemoveContainer" containerID="2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca"
Jul 20 13:47:09.710712 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:47:09.710693    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca\": container with ID starting with 2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca not found: ID does not exist" containerID="2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca"
Jul 20 13:47:09.710775 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.710725    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca"} err="failed to get container status \"2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca\": rpc error: code = NotFound desc = could not find container \"2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca\": container with ID starting with 2b0125b994cfcb2529b12db2d3f82ab197dc177c3bffc7c5e4816dae3f1b78ca not found: ID does not exist"
Jul 20 13:47:09.720666 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.720637    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2mbf"]
Jul 20 13:47:09.726710 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:09.726682    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2mbf"]
Jul 20 13:47:11.192250 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:11.192214    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b8c1848-9dc0-400a-8ffc-a99a8b64de75" path="/var/lib/kubelet/pods/2b8c1848-9dc0-400a-8ffc-a99a8b64de75/volumes"
Jul 20 13:47:32.518448 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.518404    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jll4x"]
Jul 20 13:47:32.518942 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.518928    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8c1848-9dc0-400a-8ffc-a99a8b64de75" containerName="authorino"
Jul 20 13:47:32.519008 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.518950    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8c1848-9dc0-400a-8ffc-a99a8b64de75" containerName="authorino"
Jul 20 13:47:32.519069 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.519055    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b8c1848-9dc0-400a-8ffc-a99a8b64de75" containerName="authorino"
Jul 20 13:47:32.522177 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.522126    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:32.524595 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.524574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-45rxl\""
Jul 20 13:47:32.529011 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.528988    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jll4x"]
Jul 20 13:47:32.692932 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.692893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfz87\" (UniqueName: \"kubernetes.io/projected/c23360f0-9478-40c8-a29d-9138387d91a6-kube-api-access-dfz87\") pod \"authorino-5d4b67c446-jll4x\" (UID: \"c23360f0-9478-40c8-a29d-9138387d91a6\") " pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:32.760618 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.760578    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jll4x"]
Jul 20 13:47:32.760890 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:47:32.760868    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dfz87], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jll4x" podUID="c23360f0-9478-40c8-a29d-9138387d91a6"
Jul 20 13:47:32.794088 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.794001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfz87\" (UniqueName: \"kubernetes.io/projected/c23360f0-9478-40c8-a29d-9138387d91a6-kube-api-access-dfz87\") pod \"authorino-5d4b67c446-jll4x\" (UID: \"c23360f0-9478-40c8-a29d-9138387d91a6\") " pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:32.805491 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.805452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfz87\" (UniqueName: \"kubernetes.io/projected/c23360f0-9478-40c8-a29d-9138387d91a6-kube-api-access-dfz87\") pod \"authorino-5d4b67c446-jll4x\" (UID: \"c23360f0-9478-40c8-a29d-9138387d91a6\") " pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:32.822038 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.822004    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:32.828915 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.828891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:32.995894 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.995855    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfz87\" (UniqueName: \"kubernetes.io/projected/c23360f0-9478-40c8-a29d-9138387d91a6-kube-api-access-dfz87\") pod \"c23360f0-9478-40c8-a29d-9138387d91a6\" (UID: \"c23360f0-9478-40c8-a29d-9138387d91a6\") "
Jul 20 13:47:32.998213 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:32.998178    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23360f0-9478-40c8-a29d-9138387d91a6-kube-api-access-dfz87" (OuterVolumeSpecName: "kube-api-access-dfz87") pod "c23360f0-9478-40c8-a29d-9138387d91a6" (UID: "c23360f0-9478-40c8-a29d-9138387d91a6"). InnerVolumeSpecName "kube-api-access-dfz87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:33.096629 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:33.096545    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfz87\" (UniqueName: \"kubernetes.io/projected/c23360f0-9478-40c8-a29d-9138387d91a6-kube-api-access-dfz87\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:47:33.827030 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:33.826995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jll4x"
Jul 20 13:47:33.858323 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:33.858281    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jll4x"]
Jul 20 13:47:33.863341 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:33.863305    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jll4x"]
Jul 20 13:47:34.758022 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.757983    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86b7b6b7bd-drfcq"]
Jul 20 13:47:34.762611 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.762586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:34.766325 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.766128    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 13:47:34.766493 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.766128    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-45rxl\""
Jul 20 13:47:34.768844 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.768819    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b7b6b7bd-drfcq"]
Jul 20 13:47:34.915651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.915609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk58n\" (UniqueName: \"kubernetes.io/projected/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-kube-api-access-kk58n\") pod \"authorino-86b7b6b7bd-drfcq\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") " pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:34.916054 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:34.915697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-tls-cert\") pod \"authorino-86b7b6b7bd-drfcq\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") " pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:35.016249 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.016126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-tls-cert\") pod \"authorino-86b7b6b7bd-drfcq\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") " pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:35.016249 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.016234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk58n\" (UniqueName: \"kubernetes.io/projected/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-kube-api-access-kk58n\") pod \"authorino-86b7b6b7bd-drfcq\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") " pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:35.018890 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.018866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-tls-cert\") pod \"authorino-86b7b6b7bd-drfcq\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") " pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:35.027907 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.027876    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk58n\" (UniqueName: \"kubernetes.io/projected/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-kube-api-access-kk58n\") pod \"authorino-86b7b6b7bd-drfcq\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") " pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:35.073455 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.073415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:47:35.194644 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.194609    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c23360f0-9478-40c8-a29d-9138387d91a6" path="/var/lib/kubelet/pods/c23360f0-9478-40c8-a29d-9138387d91a6/volumes"
Jul 20 13:47:35.219705 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.219682    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b7b6b7bd-drfcq"]
Jul 20 13:47:35.222321 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:47:35.222287    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e959add_66b5_4f15_a30c_f6c4b00d3b9a.slice/crio-14d0db4622cdc8d073959655972e103d6f08adffec71f164dbbc070ac766b049 WatchSource:0}: Error finding container 14d0db4622cdc8d073959655972e103d6f08adffec71f164dbbc070ac766b049: Status 404 returned error can't find the container with id 14d0db4622cdc8d073959655972e103d6f08adffec71f164dbbc070ac766b049
Jul 20 13:47:35.841930 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.841893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq" event={"ID":"5e959add-66b5-4f15-a30c-f6c4b00d3b9a","Type":"ContainerStarted","Data":"e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f"}
Jul 20 13:47:35.842114 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.841942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq" event={"ID":"5e959add-66b5-4f15-a30c-f6c4b00d3b9a","Type":"ContainerStarted","Data":"14d0db4622cdc8d073959655972e103d6f08adffec71f164dbbc070ac766b049"}
Jul 20 13:47:35.858417 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:47:35.858355    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq" podStartSLOduration=1.413865282 podStartE2EDuration="1.85833442s" totalImagesPullingTime="444.469138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:47:35.857441839 +0000 UTC m=+561.132686367" watchObservedRunningTime="2026-07-20 13:47:35.85833442 +0000 UTC m=+561.133578949"
Jul 20 13:48:12.973646 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.973608    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-784d565fd-clg9w"]
Jul 20 13:48:12.977117 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.977095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:12.979754 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.979728    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:48:12.980696 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.980674    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 13:48:12.980696 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.980690    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:48:12.980872 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.980681    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fglsw\""
Jul 20 13:48:12.993014 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:12.992990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-784d565fd-clg9w"]
Jul 20 13:48:13.036228 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.036152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e74af5e-ef27-407d-98f4-8e386e13780d-openshift-service-ca\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.036411 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.036318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e74af5e-ef27-407d-98f4-8e386e13780d-maas-api-tls\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.036411 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.036353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755h9\" (UniqueName: \"kubernetes.io/projected/1e74af5e-ef27-407d-98f4-8e386e13780d-kube-api-access-755h9\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.136963 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.136916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e74af5e-ef27-407d-98f4-8e386e13780d-maas-api-tls\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.136963 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.136964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755h9\" (UniqueName: \"kubernetes.io/projected/1e74af5e-ef27-407d-98f4-8e386e13780d-kube-api-access-755h9\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.137229 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.137007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e74af5e-ef27-407d-98f4-8e386e13780d-openshift-service-ca\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.137649 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.137625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e74af5e-ef27-407d-98f4-8e386e13780d-openshift-service-ca\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.139778 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.139744    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e74af5e-ef27-407d-98f4-8e386e13780d-maas-api-tls\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.146175 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.146131    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-755h9\" (UniqueName: \"kubernetes.io/projected/1e74af5e-ef27-407d-98f4-8e386e13780d-kube-api-access-755h9\") pod \"maas-api-784d565fd-clg9w\" (UID: \"1e74af5e-ef27-407d-98f4-8e386e13780d\") " pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.288737 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.288646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:13.451459 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:13.451429    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-784d565fd-clg9w"]
Jul 20 13:48:13.454986 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:48:13.454955    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e74af5e_ef27_407d_98f4_8e386e13780d.slice/crio-b1ea21fede4d743868239d04d25093704c00a638e01a2964d909b7dbc6e80efe WatchSource:0}: Error finding container b1ea21fede4d743868239d04d25093704c00a638e01a2964d909b7dbc6e80efe: Status 404 returned error can't find the container with id b1ea21fede4d743868239d04d25093704c00a638e01a2964d909b7dbc6e80efe
Jul 20 13:48:14.024588 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:14.024550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w" event={"ID":"1e74af5e-ef27-407d-98f4-8e386e13780d","Type":"ContainerStarted","Data":"b1ea21fede4d743868239d04d25093704c00a638e01a2964d909b7dbc6e80efe"}
Jul 20 13:48:16.374090 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:16.374062    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:48:16.375101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:16.375073    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:48:17.045765 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:17.045733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w" event={"ID":"1e74af5e-ef27-407d-98f4-8e386e13780d","Type":"ContainerStarted","Data":"9bcd3647d2e027c815c71b55baef65ecab0947a0ddb777f0c6429d46ad5f658e"}
Jul 20 13:48:17.045959 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:17.045836    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:17.067091 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:17.067032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w" podStartSLOduration=2.09339942 podStartE2EDuration="5.067015384s" totalImagesPullingTime="2.973615964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:48:17.065656812 +0000 UTC m=+602.340901342" watchObservedRunningTime="2026-07-20 13:48:17.067015384 +0000 UTC m=+602.342259913"
Jul 20 13:48:19.632396 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:19.632349    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gwrc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 13:48:19.632862 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:19.632440    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" podUID="bc51584f-d956-43e0-bcf3-194540f5aae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 13:48:21.067985 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:21.067946    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc51584f-d956-43e0-bcf3-194540f5aae5" containerID="4912978ea222895a23dad46a6602dbd861cc0aa8c682c7012402b8f17092b767" exitCode=0
Jul 20 13:48:21.068427 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:21.068025    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" event={"ID":"bc51584f-d956-43e0-bcf3-194540f5aae5","Type":"ContainerDied","Data":"4912978ea222895a23dad46a6602dbd861cc0aa8c682c7012402b8f17092b767"}
Jul 20 13:48:21.068471 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:21.068450    2559 scope.go:117] "RemoveContainer" containerID="4912978ea222895a23dad46a6602dbd861cc0aa8c682c7012402b8f17092b767"
Jul 20 13:48:21.069516 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:21.069485    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:48:21.069591 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:21.069577    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:48:21.069647 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:21.069632    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 13:48:22.074645 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:22.074604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" event={"ID":"bc51584f-d956-43e0-bcf3-194540f5aae5","Type":"ContainerStarted","Data":"06bc8c61ee7377f2c0a21198838f9c252d416c42f0bbc5659a15963236ebec12"}
Jul 20 13:48:22.519662 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:22.519621    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:48:22.519960 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:22.519933    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gwrc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 20 13:48:22.520059 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:22.519997    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" podUID="bc51584f-d956-43e0-bcf3-194540f5aae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 20 13:48:23.057116 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:23.057090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-784d565fd-clg9w"
Jul 20 13:48:23.520425 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:23.520388    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gwrc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 20 13:48:23.520831 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:23.520452    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" podUID="bc51584f-d956-43e0-bcf3-194540f5aae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 20 13:48:24.520095 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:24.520058    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gwrc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 20 13:48:24.520307 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:24.520118    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" podUID="bc51584f-d956-43e0-bcf3-194540f5aae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 20 13:48:25.519791 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:25.519646    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gwrc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 20 13:48:25.519791 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:25.519721    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7" podUID="bc51584f-d956-43e0-bcf3-194540f5aae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 20 13:48:26.523609 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:26.523577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:48:26.523999 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:26.523977    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:48:26.524670 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:48:26.524654    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gwrc7"
Jul 20 13:49:15.146153 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.146120    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"]
Jul 20 13:49:15.149945 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.149920    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.152448 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.152423    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 13:49:15.153542 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.153523    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 13:49:15.153661 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.153538    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 13:49:15.153661 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.153577    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dmnrn\""
Jul 20 13:49:15.159985 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.159955    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"]
Jul 20 13:49:15.285410 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.285367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.285591 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.285427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bt7\" (UniqueName: \"kubernetes.io/projected/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-kube-api-access-n8bt7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.285591 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.285490    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.285591 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.285507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.285591 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.285536    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.285591 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.285555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386066 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bt7\" (UniqueName: \"kubernetes.io/projected/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-kube-api-access-n8bt7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386315 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386315 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386315 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386315 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386315 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386567 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386668 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.386726 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.386690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.388717 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.388696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.388875 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.388856    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.395093 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.395053    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bt7\" (UniqueName: \"kubernetes.io/projected/aa30f818-5d13-46a5-b58d-d8d27c8e0d45-kube-api-access-n8bt7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg\" (UID: \"aa30f818-5d13-46a5-b58d-d8d27c8e0d45\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.463251 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.463145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:15.609085 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.609058    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"]
Jul 20 13:49:15.611598 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:49:15.611564    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa30f818_5d13_46a5_b58d_d8d27c8e0d45.slice/crio-767e09776b340e36465fd17a25b4bc60292f888a9ad9cc7cd75212a84af30512 WatchSource:0}: Error finding container 767e09776b340e36465fd17a25b4bc60292f888a9ad9cc7cd75212a84af30512: Status 404 returned error can't find the container with id 767e09776b340e36465fd17a25b4bc60292f888a9ad9cc7cd75212a84af30512
Jul 20 13:49:15.612949 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:15.612930    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:49:16.346444 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:16.346403    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg" event={"ID":"aa30f818-5d13-46a5-b58d-d8d27c8e0d45","Type":"ContainerStarted","Data":"767e09776b340e36465fd17a25b4bc60292f888a9ad9cc7cd75212a84af30512"}
Jul 20 13:49:17.353540 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:17.353504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg" event={"ID":"aa30f818-5d13-46a5-b58d-d8d27c8e0d45","Type":"ContainerStarted","Data":"5ec92d81f4e6f59db238e2a2d9fc8722a8d4ecdbedc5a9dac47d2abe713c0478"}
Jul 20 13:49:17.370803 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:17.370737    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg" podStartSLOduration=1.287590459 podStartE2EDuration="2.370720986s" totalImagesPullingTime="1.083130527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:49:17.369636618 +0000 UTC m=+662.644881147" watchObservedRunningTime="2026-07-20 13:49:17.370720986 +0000 UTC m=+662.645965514"
Jul 20 13:49:25.463392 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:25.463357    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:25.463876 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:25.463413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:25.476884 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:25.476853    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:26.409605 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:26.409571    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg"
Jul 20 13:49:42.844449 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.844402    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"]
Jul 20 13:49:42.848080 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.848053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:42.850872 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.850847    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 13:49:42.858199 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.858147    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"]
Jul 20 13:49:42.943959 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.943894    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4bd\" (UniqueName: \"kubernetes.io/projected/2ecd18af-e683-4274-9b1c-e1bf7f889688-kube-api-access-qw4bd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:42.944209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.943970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecd18af-e683-4274-9b1c-e1bf7f889688-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:42.944209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.944000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:42.944209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.944022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:42.944209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.944051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:42.944209 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:42.944153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045429 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045381    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4bd\" (UniqueName: \"kubernetes.io/projected/2ecd18af-e683-4274-9b1c-e1bf7f889688-kube-api-access-qw4bd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045429 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecd18af-e683-4274-9b1c-e1bf7f889688-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045685 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045685 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045685 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045685 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.045961 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.046039 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.045996    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.046090 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.046059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.048042 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.048011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ecd18af-e683-4274-9b1c-e1bf7f889688-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.048322 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.048302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ecd18af-e683-4274-9b1c-e1bf7f889688-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.054682 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.054648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4bd\" (UniqueName: \"kubernetes.io/projected/2ecd18af-e683-4274-9b1c-e1bf7f889688-kube-api-access-qw4bd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5j458\" (UID: \"2ecd18af-e683-4274-9b1c-e1bf7f889688\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.158645 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.158599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:43.302296 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.302271    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"]
Jul 20 13:49:43.304515 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:49:43.304488    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ecd18af_e683_4274_9b1c_e1bf7f889688.slice/crio-ea46ff1ceab1eea94af9b9a4366a73a545a31fb5c2953dedaf28ba9afa47f4d2 WatchSource:0}: Error finding container ea46ff1ceab1eea94af9b9a4366a73a545a31fb5c2953dedaf28ba9afa47f4d2: Status 404 returned error can't find the container with id ea46ff1ceab1eea94af9b9a4366a73a545a31fb5c2953dedaf28ba9afa47f4d2
Jul 20 13:49:43.490887 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:43.490844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458" event={"ID":"2ecd18af-e683-4274-9b1c-e1bf7f889688","Type":"ContainerStarted","Data":"ea46ff1ceab1eea94af9b9a4366a73a545a31fb5c2953dedaf28ba9afa47f4d2"}
Jul 20 13:49:44.498380 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:44.498341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458" event={"ID":"2ecd18af-e683-4274-9b1c-e1bf7f889688","Type":"ContainerStarted","Data":"bc6459af54ddeccaa11fba3fc3af5f4ee88e35c02783df3833bf569548241323"}
Jul 20 13:49:44.517101 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:44.517039    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458" podStartSLOduration=2.338179963 podStartE2EDuration="2.517021981s" totalImagesPullingTime="178.842018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:49:44.514671319 +0000 UTC m=+689.789915848" watchObservedRunningTime="2026-07-20 13:49:44.517021981 +0000 UTC m=+689.792266510"
Jul 20 13:49:53.159433 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:53.159379    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:53.159433 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:53.159440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:53.172084 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:53.172058    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:49:53.554828 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:49:53.554731    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5j458"
Jul 20 13:50:50.484394 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.484356    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b7b6b7bd-drfcq"]
Jul 20 13:50:50.485021 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.484549    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq" podUID="5e959add-66b5-4f15-a30c-f6c4b00d3b9a" containerName="authorino" containerID="cri-o://e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f" gracePeriod=30
Jul 20 13:50:50.747956 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.747883    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:50:50.831881 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.831844    2559 generic.go:356] "Generic (PLEG): container finished" podID="5e959add-66b5-4f15-a30c-f6c4b00d3b9a" containerID="e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f" exitCode=0
Jul 20 13:50:50.832087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.831894    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq"
Jul 20 13:50:50.832087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.831936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq" event={"ID":"5e959add-66b5-4f15-a30c-f6c4b00d3b9a","Type":"ContainerDied","Data":"e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f"}
Jul 20 13:50:50.832087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.831980    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b7b6b7bd-drfcq" event={"ID":"5e959add-66b5-4f15-a30c-f6c4b00d3b9a","Type":"ContainerDied","Data":"14d0db4622cdc8d073959655972e103d6f08adffec71f164dbbc070ac766b049"}
Jul 20 13:50:50.832087 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.831997    2559 scope.go:117] "RemoveContainer" containerID="e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f"
Jul 20 13:50:50.841222 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.841200    2559 scope.go:117] "RemoveContainer" containerID="e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f"
Jul 20 13:50:50.841582 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:50:50.841563    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f\": container with ID starting with e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f not found: ID does not exist" containerID="e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f"
Jul 20 13:50:50.841649 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.841594    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f"} err="failed to get container status \"e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f\": rpc error: code = NotFound desc = could not find container \"e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f\": container with ID starting with e22668601f5a159cd6e6ebf47b93d6304447dbed6812706228339930683a173f not found: ID does not exist"
Jul 20 13:50:50.889010 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.888970    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk58n\" (UniqueName: \"kubernetes.io/projected/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-kube-api-access-kk58n\") pod \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") "
Jul 20 13:50:50.889222 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.889024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-tls-cert\") pod \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\" (UID: \"5e959add-66b5-4f15-a30c-f6c4b00d3b9a\") "
Jul 20 13:50:50.891391 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.891362    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-kube-api-access-kk58n" (OuterVolumeSpecName: "kube-api-access-kk58n") pod "5e959add-66b5-4f15-a30c-f6c4b00d3b9a" (UID: "5e959add-66b5-4f15-a30c-f6c4b00d3b9a"). InnerVolumeSpecName "kube-api-access-kk58n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:50:50.901541 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.901485    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5e959add-66b5-4f15-a30c-f6c4b00d3b9a" (UID: "5e959add-66b5-4f15-a30c-f6c4b00d3b9a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:50:50.990030 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.989991    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk58n\" (UniqueName: \"kubernetes.io/projected/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-kube-api-access-kk58n\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:50:50.990030 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:50.990023    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e959add-66b5-4f15-a30c-f6c4b00d3b9a-tls-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:50:51.157105 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:51.157066    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b7b6b7bd-drfcq"]
Jul 20 13:50:51.173859 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:51.173824    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86b7b6b7bd-drfcq"]
Jul 20 13:50:51.193334 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:50:51.193295    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e959add-66b5-4f15-a30c-f6c4b00d3b9a" path="/var/lib/kubelet/pods/5e959add-66b5-4f15-a30c-f6c4b00d3b9a/volumes"
Jul 20 13:53:16.404792 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:53:16.404747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:53:16.406227 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:53:16.406207    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:57:50.773648 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:50.773553    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"]
Jul 20 13:57:50.774238 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:50.773854    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn" podUID="defe6644-fa9b-4b2e-a968-9c293c3755d2" containerName="manager" containerID="cri-o://9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f" gracePeriod=10
Jul 20 13:57:54.331949 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.331923    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:57:54.491516 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.491478    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/defe6644-fa9b-4b2e-a968-9c293c3755d2-extensions-socket-volume\") pod \"defe6644-fa9b-4b2e-a968-9c293c3755d2\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") "
Jul 20 13:57:54.491516 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.491519    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6rw5\" (UniqueName: \"kubernetes.io/projected/defe6644-fa9b-4b2e-a968-9c293c3755d2-kube-api-access-v6rw5\") pod \"defe6644-fa9b-4b2e-a968-9c293c3755d2\" (UID: \"defe6644-fa9b-4b2e-a968-9c293c3755d2\") "
Jul 20 13:57:54.491870 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.491845    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/defe6644-fa9b-4b2e-a968-9c293c3755d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "defe6644-fa9b-4b2e-a968-9c293c3755d2" (UID: "defe6644-fa9b-4b2e-a968-9c293c3755d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:57:54.493832 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.493796    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defe6644-fa9b-4b2e-a968-9c293c3755d2-kube-api-access-v6rw5" (OuterVolumeSpecName: "kube-api-access-v6rw5") pod "defe6644-fa9b-4b2e-a968-9c293c3755d2" (UID: "defe6644-fa9b-4b2e-a968-9c293c3755d2"). InnerVolumeSpecName "kube-api-access-v6rw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:57:54.593043 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.593001    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/defe6644-fa9b-4b2e-a968-9c293c3755d2-extensions-socket-volume\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:57:54.593043 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.593038    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6rw5\" (UniqueName: \"kubernetes.io/projected/defe6644-fa9b-4b2e-a968-9c293c3755d2-kube-api-access-v6rw5\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 13:57:54.931816 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.931783    2559 generic.go:356] "Generic (PLEG): container finished" podID="defe6644-fa9b-4b2e-a968-9c293c3755d2" containerID="9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f" exitCode=0
Jul 20 13:57:54.931997 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.931829    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"
Jul 20 13:57:54.931997 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.931857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn" event={"ID":"defe6644-fa9b-4b2e-a968-9c293c3755d2","Type":"ContainerDied","Data":"9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f"}
Jul 20 13:57:54.931997 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.931900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn" event={"ID":"defe6644-fa9b-4b2e-a968-9c293c3755d2","Type":"ContainerDied","Data":"8306ed00263f6ba0248f47160b33fcd0b4bf8a193a6e43b251659adab5124614"}
Jul 20 13:57:54.931997 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.931920    2559 scope.go:117] "RemoveContainer" containerID="9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f"
Jul 20 13:57:54.941936 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.941919    2559 scope.go:117] "RemoveContainer" containerID="9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f"
Jul 20 13:57:54.942227 ip-10-0-131-139 kubenswrapper[2559]: E0720 13:57:54.942204    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f\": container with ID starting with 9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f not found: ID does not exist" containerID="9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f"
Jul 20 13:57:54.942304 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.942238    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f"} err="failed to get container status \"9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f\": rpc error: code = NotFound desc = could not find container \"9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f\": container with ID starting with 9b9e4776758ce93fcedb0841dc7c0d0a26da4b14384cd8bbbd6c297f9647c96f not found: ID does not exist"
Jul 20 13:57:54.952412 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.952383    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"]
Jul 20 13:57:54.956919 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:54.956898    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szhmn"]
Jul 20 13:57:55.199748 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:57:55.199664    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="defe6644-fa9b-4b2e-a968-9c293c3755d2" path="/var/lib/kubelet/pods/defe6644-fa9b-4b2e-a968-9c293c3755d2/volumes"
Jul 20 13:58:16.434437 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:16.434402    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:58:16.438624 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:16.438583    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 13:58:52.000151 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"]
Jul 20 13:58:52.000636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000486    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e959add-66b5-4f15-a30c-f6c4b00d3b9a" containerName="authorino"
Jul 20 13:58:52.000636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000499    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e959add-66b5-4f15-a30c-f6c4b00d3b9a" containerName="authorino"
Jul 20 13:58:52.000636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000522    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="defe6644-fa9b-4b2e-a968-9c293c3755d2" containerName="manager"
Jul 20 13:58:52.000636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000528    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="defe6644-fa9b-4b2e-a968-9c293c3755d2" containerName="manager"
Jul 20 13:58:52.000636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000586    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="defe6644-fa9b-4b2e-a968-9c293c3755d2" containerName="manager"
Jul 20 13:58:52.000636 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.000595    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e959add-66b5-4f15-a30c-f6c4b00d3b9a" containerName="authorino"
Jul 20 13:58:52.003523 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.003506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.006990 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.006967    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7r46h\""
Jul 20 13:58:52.017121 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.017094    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"]
Jul 20 13:58:52.082833 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.082790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2kw9\" (UniqueName: \"kubernetes.io/projected/9d9852ac-edd9-421a-862b-f9eaef24a6bf-kube-api-access-f2kw9\") pod \"kuadrant-operator-controller-manager-86878c769f-xwvft\" (UID: \"9d9852ac-edd9-421a-862b-f9eaef24a6bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.083014 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.082933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d9852ac-edd9-421a-862b-f9eaef24a6bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xwvft\" (UID: \"9d9852ac-edd9-421a-862b-f9eaef24a6bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.183914 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.183867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d9852ac-edd9-421a-862b-f9eaef24a6bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xwvft\" (UID: \"9d9852ac-edd9-421a-862b-f9eaef24a6bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.184083 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.183939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2kw9\" (UniqueName: \"kubernetes.io/projected/9d9852ac-edd9-421a-862b-f9eaef24a6bf-kube-api-access-f2kw9\") pod \"kuadrant-operator-controller-manager-86878c769f-xwvft\" (UID: \"9d9852ac-edd9-421a-862b-f9eaef24a6bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.184270 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.184249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d9852ac-edd9-421a-862b-f9eaef24a6bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xwvft\" (UID: \"9d9852ac-edd9-421a-862b-f9eaef24a6bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.192716 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.192677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2kw9\" (UniqueName: \"kubernetes.io/projected/9d9852ac-edd9-421a-862b-f9eaef24a6bf-kube-api-access-f2kw9\") pod \"kuadrant-operator-controller-manager-86878c769f-xwvft\" (UID: \"9d9852ac-edd9-421a-862b-f9eaef24a6bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.314889 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.314797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:52.468091 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:52.468023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"]
Jul 20 13:58:52.470556 ip-10-0-131-139 kubenswrapper[2559]: W0720 13:58:52.470528    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9852ac_edd9_421a_862b_f9eaef24a6bf.slice/crio-3a4beda6f08958229b4ee0d3442782b7b4e8b814788da64c4467426475bdcac0 WatchSource:0}: Error finding container 3a4beda6f08958229b4ee0d3442782b7b4e8b814788da64c4467426475bdcac0: Status 404 returned error can't find the container with id 3a4beda6f08958229b4ee0d3442782b7b4e8b814788da64c4467426475bdcac0
Jul 20 13:58:53.211226 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:53.211180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft" event={"ID":"9d9852ac-edd9-421a-862b-f9eaef24a6bf","Type":"ContainerStarted","Data":"31dc4405c3b1cc8b771adff0c54fa8a74bfbff0649350708d4e1dbf42208a59c"}
Jul 20 13:58:53.211651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:53.211234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft" event={"ID":"9d9852ac-edd9-421a-862b-f9eaef24a6bf","Type":"ContainerStarted","Data":"3a4beda6f08958229b4ee0d3442782b7b4e8b814788da64c4467426475bdcac0"}
Jul 20 13:58:53.211651 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:53.211320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 13:58:53.231298 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:58:53.231245    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft" podStartSLOduration=2.231227736 podStartE2EDuration="2.231227736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:58:53.228928385 +0000 UTC m=+1238.504172913" watchObservedRunningTime="2026-07-20 13:58:53.231227736 +0000 UTC m=+1238.506472265"
Jul 20 13:59:04.218394 ip-10-0-131-139 kubenswrapper[2559]: I0720 13:59:04.218363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xwvft"
Jul 20 14:00:00.160676 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.160640    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"]
Jul 20 14:00:00.164412 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.164391    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"
Jul 20 14:00:00.167273 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.167249    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:00:00.173959 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.173928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"
Jul 20 14:00:00.176340 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.176275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"]
Jul 20 14:00:00.318407 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.318379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"]
Jul 20 14:00:00.320533 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:00:00.320507    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e27db54_86b4_494a_98c0_ba175b5fe395.slice/crio-f8a7ebc4e9acfebddd54fccd0ebeac7955075ec77d6fdfb5e73fd99aaa18e75c WatchSource:0}: Error finding container f8a7ebc4e9acfebddd54fccd0ebeac7955075ec77d6fdfb5e73fd99aaa18e75c: Status 404 returned error can't find the container with id f8a7ebc4e9acfebddd54fccd0ebeac7955075ec77d6fdfb5e73fd99aaa18e75c
Jul 20 14:00:00.322759 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.322743    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 14:00:00.535908 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:00.535824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk" event={"ID":"1e27db54-86b4-494a-98c0-ba175b5fe395","Type":"ContainerStarted","Data":"f8a7ebc4e9acfebddd54fccd0ebeac7955075ec77d6fdfb5e73fd99aaa18e75c"}
Jul 20 14:00:13.608413 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:13.608377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk" event={"ID":"1e27db54-86b4-494a-98c0-ba175b5fe395","Type":"ContainerStarted","Data":"14f3b45b497e7828cca7937793129aa518fb3bf63d30e88ea7046e71e1902b0e"}
Jul 20 14:00:13.625923 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:13.625861    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk" podStartSLOduration=0.88430328 podStartE2EDuration="13.625842691s" totalImagesPullingTime="12.741539411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:00:13.624079492 +0000 UTC m=+1318.899324021" watchObservedRunningTime="2026-07-20 14:00:13.625842691 +0000 UTC m=+1318.901087220"
Jul 20 14:00:14.615234 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:14.615198    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e27db54-86b4-494a-98c0-ba175b5fe395" containerID="14f3b45b497e7828cca7937793129aa518fb3bf63d30e88ea7046e71e1902b0e" exitCode=0
Jul 20 14:00:14.615682 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:14.615284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk" event={"ID":"1e27db54-86b4-494a-98c0-ba175b5fe395","Type":"ContainerDied","Data":"14f3b45b497e7828cca7937793129aa518fb3bf63d30e88ea7046e71e1902b0e"}
Jul 20 14:00:15.759011 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:15.758983    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"
Jul 20 14:00:16.627065 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:16.627028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk" event={"ID":"1e27db54-86b4-494a-98c0-ba175b5fe395","Type":"ContainerDied","Data":"f8a7ebc4e9acfebddd54fccd0ebeac7955075ec77d6fdfb5e73fd99aaa18e75c"}
Jul 20 14:00:16.627065 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:16.627051    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742600-9p5fk"
Jul 20 14:00:16.627351 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:00:16.627082    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8a7ebc4e9acfebddd54fccd0ebeac7955075ec77d6fdfb5e73fd99aaa18e75c"
Jul 20 14:01:42.171538 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.171501    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"]
Jul 20 14:01:42.172006 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.171869    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e27db54-86b4-494a-98c0-ba175b5fe395" containerName="cleanup"
Jul 20 14:01:42.172006 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.171880    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e27db54-86b4-494a-98c0-ba175b5fe395" containerName="cleanup"
Jul 20 14:01:42.172006 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.171936    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e27db54-86b4-494a-98c0-ba175b5fe395" containerName="cleanup"
Jul 20 14:01:42.174887 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.174869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.177615 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.177587    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-7ac02280-kserve-self-signed-certs\""
Jul 20 14:01:42.187618 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.187592    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"]
Jul 20 14:01:42.312414 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.312372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-model-cache\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.312414 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.312423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-home\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.312669 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.312527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhh8c\" (UniqueName: \"kubernetes.io/projected/5a1fc206-1c48-4744-8159-ed660fd43528-kube-api-access-zhh8c\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.312669 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.312564    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-dshm\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.312669 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.312631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1fc206-1c48-4744-8159-ed660fd43528-tls-certs\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.312825 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.312732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-tmp-dir\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.413599 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.413563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhh8c\" (UniqueName: \"kubernetes.io/projected/5a1fc206-1c48-4744-8159-ed660fd43528-kube-api-access-zhh8c\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.413821 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.413614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-dshm\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.413821 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.413646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1fc206-1c48-4744-8159-ed660fd43528-tls-certs\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.413821 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.413696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-tmp-dir\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.413821 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.413753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-model-cache\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.413821 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.413778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-home\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.414310 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.414285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-tmp-dir\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.414435 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.414348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-home\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.414435 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.414386    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-model-cache\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.416293 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.416268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-dshm\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.416509 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.416490    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1fc206-1c48-4744-8159-ed660fd43528-tls-certs\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.422803 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.422746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhh8c\" (UniqueName: \"kubernetes.io/projected/5a1fc206-1c48-4744-8159-ed660fd43528-kube-api-access-zhh8c\") pod \"e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") " pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.484594 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.484549    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:42.637171 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:42.637126    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"]
Jul 20 14:01:42.638720 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:01:42.638696    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a1fc206_1c48_4744_8159_ed660fd43528.slice/crio-500e57553d077f9762e8f5dc6c41f25813fa896e0ae7959710aa18429e0a388d WatchSource:0}: Error finding container 500e57553d077f9762e8f5dc6c41f25813fa896e0ae7959710aa18429e0a388d: Status 404 returned error can't find the container with id 500e57553d077f9762e8f5dc6c41f25813fa896e0ae7959710aa18429e0a388d
Jul 20 14:01:43.054444 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:43.054338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966" event={"ID":"5a1fc206-1c48-4744-8159-ed660fd43528","Type":"ContainerStarted","Data":"966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028"}
Jul 20 14:01:43.054444 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:43.054388    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966" event={"ID":"5a1fc206-1c48-4744-8159-ed660fd43528","Type":"ContainerStarted","Data":"500e57553d077f9762e8f5dc6c41f25813fa896e0ae7959710aa18429e0a388d"}
Jul 20 14:01:43.075249 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:43.075194    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966" podStartSLOduration=1.075149266 podStartE2EDuration="1.075149266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:01:43.073557744 +0000 UTC m=+1408.348802272" watchObservedRunningTime="2026-07-20 14:01:43.075149266 +0000 UTC m=+1408.350393817"
Jul 20 14:01:46.979470 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:46.979437    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"]
Jul 20 14:01:46.982843 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:46.982824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:46.992255 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:46.992233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-7ac02280-kserve-self-signed-certs\""
Jul 20 14:01:47.003596 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.003563    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"]
Jul 20 14:01:47.058965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.058927    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tmp-dir\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.059146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.058988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvr5k\" (UniqueName: \"kubernetes.io/projected/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-kube-api-access-lvr5k\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.059146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.059077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-home\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.059146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.059130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-dshm\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.059305 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.059199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tls-certs\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.059305 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.059225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-model-cache\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160518 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tmp-dir\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160722 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvr5k\" (UniqueName: \"kubernetes.io/projected/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-kube-api-access-lvr5k\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160722 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-home\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160722 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-dshm\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160722 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160681    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tls-certs\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160722 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-model-cache\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160975 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tmp-dir\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.160975 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.160943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-home\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.161104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.161082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-model-cache\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.163028 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.163005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-dshm\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.163215 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.163197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tls-certs\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.183827 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.183794    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvr5k\" (UniqueName: \"kubernetes.io/projected/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-kube-api-access-lvr5k\") pod \"e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") " pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.292831 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.292739    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:47.452600 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:47.452575    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"]
Jul 20 14:01:47.455178 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:01:47.455136    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5411ead2_c9c6_4c25_be5a_9bd61ff93e08.slice/crio-ed9c5814b76a47b8bbb20f5d6cdc67aefabb103f83da63d2252c026c8b6ddfb9 WatchSource:0}: Error finding container ed9c5814b76a47b8bbb20f5d6cdc67aefabb103f83da63d2252c026c8b6ddfb9: Status 404 returned error can't find the container with id ed9c5814b76a47b8bbb20f5d6cdc67aefabb103f83da63d2252c026c8b6ddfb9
Jul 20 14:01:48.082789 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:48.082749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f" event={"ID":"5411ead2-c9c6-4c25-be5a-9bd61ff93e08","Type":"ContainerStarted","Data":"f31e2fb9dc346a67fedd7833a4d32934b4268435a1d8eae425f46244a52fe4ef"}
Jul 20 14:01:48.083191 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:48.082800    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f" event={"ID":"5411ead2-c9c6-4c25-be5a-9bd61ff93e08","Type":"ContainerStarted","Data":"ed9c5814b76a47b8bbb20f5d6cdc67aefabb103f83da63d2252c026c8b6ddfb9"}
Jul 20 14:01:48.145443 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:48.145386    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f" podStartSLOduration=2.145368488 podStartE2EDuration="2.145368488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:01:48.145047538 +0000 UTC m=+1413.420292069" watchObservedRunningTime="2026-07-20 14:01:48.145368488 +0000 UTC m=+1413.420613016"
Jul 20 14:01:52.485186 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:52.485117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:52.485723 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:52.485304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:52.502009 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:52.501974    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:53.118405 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:53.118372    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:01:57.293594 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:57.293555    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:57.294005 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:57.293617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:57.306528 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:57.306498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:01:58.144205 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:01:58.144144    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:02:36.412285 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:36.412196    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"]
Jul 20 14:02:38.197415 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:38.197382    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"]
Jul 20 14:02:51.433502 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.433437    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966" podUID="5a1fc206-1c48-4744-8159-ed660fd43528" containerName="main" containerID="cri-o://966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028" gracePeriod=45
Jul 20 14:02:51.698365 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.698293    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:02:51.868897 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.868856    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-dshm\") pod \"5a1fc206-1c48-4744-8159-ed660fd43528\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") "
Jul 20 14:02:51.869080 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.868938    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-home\") pod \"5a1fc206-1c48-4744-8159-ed660fd43528\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") "
Jul 20 14:02:51.869080 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.868982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhh8c\" (UniqueName: \"kubernetes.io/projected/5a1fc206-1c48-4744-8159-ed660fd43528-kube-api-access-zhh8c\") pod \"5a1fc206-1c48-4744-8159-ed660fd43528\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") "
Jul 20 14:02:51.869080 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869051    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-model-cache\") pod \"5a1fc206-1c48-4744-8159-ed660fd43528\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") "
Jul 20 14:02:51.869080 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869077    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-tmp-dir\") pod \"5a1fc206-1c48-4744-8159-ed660fd43528\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") "
Jul 20 14:02:51.869358 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1fc206-1c48-4744-8159-ed660fd43528-tls-certs\") pod \"5a1fc206-1c48-4744-8159-ed660fd43528\" (UID: \"5a1fc206-1c48-4744-8159-ed660fd43528\") "
Jul 20 14:02:51.869358 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-home" (OuterVolumeSpecName: "home") pod "5a1fc206-1c48-4744-8159-ed660fd43528" (UID: "5a1fc206-1c48-4744-8159-ed660fd43528"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:51.869455 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869380    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a1fc206-1c48-4744-8159-ed660fd43528" (UID: "5a1fc206-1c48-4744-8159-ed660fd43528"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:51.869455 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869393    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a1fc206-1c48-4744-8159-ed660fd43528" (UID: "5a1fc206-1c48-4744-8159-ed660fd43528"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:51.869588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869555    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-model-cache\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:51.869588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869591    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-tmp-dir\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:51.869946 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.869603    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-home\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:51.871460 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.871434    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-dshm" (OuterVolumeSpecName: "dshm") pod "5a1fc206-1c48-4744-8159-ed660fd43528" (UID: "5a1fc206-1c48-4744-8159-ed660fd43528"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:51.871460 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.871444    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a1fc206-1c48-4744-8159-ed660fd43528-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a1fc206-1c48-4744-8159-ed660fd43528" (UID: "5a1fc206-1c48-4744-8159-ed660fd43528"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:02:51.871591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.871456    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1fc206-1c48-4744-8159-ed660fd43528-kube-api-access-zhh8c" (OuterVolumeSpecName: "kube-api-access-zhh8c") pod "5a1fc206-1c48-4744-8159-ed660fd43528" (UID: "5a1fc206-1c48-4744-8159-ed660fd43528"). InnerVolumeSpecName "kube-api-access-zhh8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:02:51.970836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.970750    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a1fc206-1c48-4744-8159-ed660fd43528-dshm\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:51.970836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.970780    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhh8c\" (UniqueName: \"kubernetes.io/projected/5a1fc206-1c48-4744-8159-ed660fd43528-kube-api-access-zhh8c\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:51.970836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:51.970791    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a1fc206-1c48-4744-8159-ed660fd43528-tls-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:52.406378 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.406346    2559 generic.go:356] "Generic (PLEG): container finished" podID="5a1fc206-1c48-4744-8159-ed660fd43528" containerID="966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028" exitCode=0
Jul 20 14:02:52.406549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.406396    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966" event={"ID":"5a1fc206-1c48-4744-8159-ed660fd43528","Type":"ContainerDied","Data":"966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028"}
Jul 20 14:02:52.406549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.406400    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"
Jul 20 14:02:52.406549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.406429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966" event={"ID":"5a1fc206-1c48-4744-8159-ed660fd43528","Type":"ContainerDied","Data":"500e57553d077f9762e8f5dc6c41f25813fa896e0ae7959710aa18429e0a388d"}
Jul 20 14:02:52.406549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.406445    2559 scope.go:117] "RemoveContainer" containerID="966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028"
Jul 20 14:02:52.415980 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.415961    2559 scope.go:117] "RemoveContainer" containerID="966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028"
Jul 20 14:02:52.416272 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:02:52.416253    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028\": container with ID starting with 966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028 not found: ID does not exist" containerID="966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028"
Jul 20 14:02:52.416334 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.416282    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028"} err="failed to get container status \"966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028\": rpc error: code = NotFound desc = could not find container \"966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028\": container with ID starting with 966f3251f657554c8fac90fe2f5d8a17666e79fcb4d95cbfda0b3d76a3fdb028 not found: ID does not exist"
Jul 20 14:02:52.428791 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.428763    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"]
Jul 20 14:02:52.434430 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:52.434404    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-7ac02280-kserve-6f5fd5bfb7-tr966"]
Jul 20 14:02:53.193059 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.193021    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a1fc206-1c48-4744-8159-ed660fd43528" path="/var/lib/kubelet/pods/5a1fc206-1c48-4744-8159-ed660fd43528/volumes"
Jul 20 14:02:53.218951 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.218908    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f" podUID="5411ead2-c9c6-4c25-be5a-9bd61ff93e08" containerName="main" containerID="cri-o://f31e2fb9dc346a67fedd7833a4d32934b4268435a1d8eae425f46244a52fe4ef" gracePeriod=45
Jul 20 14:02:53.414675 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.414643    2559 generic.go:356] "Generic (PLEG): container finished" podID="5411ead2-c9c6-4c25-be5a-9bd61ff93e08" containerID="f31e2fb9dc346a67fedd7833a4d32934b4268435a1d8eae425f46244a52fe4ef" exitCode=0
Jul 20 14:02:53.414860 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.414712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f" event={"ID":"5411ead2-c9c6-4c25-be5a-9bd61ff93e08","Type":"ContainerDied","Data":"f31e2fb9dc346a67fedd7833a4d32934b4268435a1d8eae425f46244a52fe4ef"}
Jul 20 14:02:53.476132 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.476106    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:02:53.585271 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585238    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-dshm\") pod \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") "
Jul 20 14:02:53.585484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585293    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-model-cache\") pod \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") "
Jul 20 14:02:53.585484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tmp-dir\") pod \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") "
Jul 20 14:02:53.585484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-home\") pod \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") "
Jul 20 14:02:53.585484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585440    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvr5k\" (UniqueName: \"kubernetes.io/projected/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-kube-api-access-lvr5k\") pod \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") "
Jul 20 14:02:53.585484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585464    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tls-certs\") pod \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\" (UID: \"5411ead2-c9c6-4c25-be5a-9bd61ff93e08\") "
Jul 20 14:02:53.585737 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585597    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-model-cache" (OuterVolumeSpecName: "model-cache") pod "5411ead2-c9c6-4c25-be5a-9bd61ff93e08" (UID: "5411ead2-c9c6-4c25-be5a-9bd61ff93e08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:53.585737 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585629    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5411ead2-c9c6-4c25-be5a-9bd61ff93e08" (UID: "5411ead2-c9c6-4c25-be5a-9bd61ff93e08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:53.585836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585729    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-home" (OuterVolumeSpecName: "home") pod "5411ead2-c9c6-4c25-be5a-9bd61ff93e08" (UID: "5411ead2-c9c6-4c25-be5a-9bd61ff93e08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:53.585836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585798    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-model-cache\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:53.585836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.585818    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tmp-dir\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:53.587661 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.587629    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5411ead2-c9c6-4c25-be5a-9bd61ff93e08" (UID: "5411ead2-c9c6-4c25-be5a-9bd61ff93e08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:02:53.587778 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.587683    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-kube-api-access-lvr5k" (OuterVolumeSpecName: "kube-api-access-lvr5k") pod "5411ead2-c9c6-4c25-be5a-9bd61ff93e08" (UID: "5411ead2-c9c6-4c25-be5a-9bd61ff93e08"). InnerVolumeSpecName "kube-api-access-lvr5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:02:53.587778 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.587687    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-dshm" (OuterVolumeSpecName: "dshm") pod "5411ead2-c9c6-4c25-be5a-9bd61ff93e08" (UID: "5411ead2-c9c6-4c25-be5a-9bd61ff93e08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:02:53.687226 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.687190    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-dshm\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:53.687226 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.687221    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-home\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:53.687226 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.687233    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvr5k\" (UniqueName: \"kubernetes.io/projected/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-kube-api-access-lvr5k\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:53.687458 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:53.687243    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5411ead2-c9c6-4c25-be5a-9bd61ff93e08-tls-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:02:54.420674 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:54.420630    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"
Jul 20 14:02:54.420674 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:54.420657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f" event={"ID":"5411ead2-c9c6-4c25-be5a-9bd61ff93e08","Type":"ContainerDied","Data":"ed9c5814b76a47b8bbb20f5d6cdc67aefabb103f83da63d2252c026c8b6ddfb9"}
Jul 20 14:02:54.420888 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:54.420708    2559 scope.go:117] "RemoveContainer" containerID="f31e2fb9dc346a67fedd7833a4d32934b4268435a1d8eae425f46244a52fe4ef"
Jul 20 14:02:54.447590 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:54.447559    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"]
Jul 20 14:02:54.453504 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:54.453477    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-7ac02280-kserve-786d6684c5-w977f"]
Jul 20 14:02:55.193954 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:02:55.193912    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5411ead2-c9c6-4c25-be5a-9bd61ff93e08" path="/var/lib/kubelet/pods/5411ead2-c9c6-4c25-be5a-9bd61ff93e08/volumes"
Jul 20 14:03:16.469680 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:03:16.469638    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:03:16.475291 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:03:16.475263    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:06:02.056775 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.056740    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"]
Jul 20 14:06:02.059202 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.057113    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a1fc206-1c48-4744-8159-ed660fd43528" containerName="main"
Jul 20 14:06:02.059202 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.057124    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a1fc206-1c48-4744-8159-ed660fd43528" containerName="main"
Jul 20 14:06:02.059202 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.057132    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5411ead2-c9c6-4c25-be5a-9bd61ff93e08" containerName="main"
Jul 20 14:06:02.059202 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.057138    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5411ead2-c9c6-4c25-be5a-9bd61ff93e08" containerName="main"
Jul 20 14:06:02.059202 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.057259    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a1fc206-1c48-4744-8159-ed660fd43528" containerName="main"
Jul 20 14:06:02.059202 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.057271    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5411ead2-c9c6-4c25-be5a-9bd61ff93e08" containerName="main"
Jul 20 14:06:02.060231 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.060213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.062516 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.062492    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-35fa4021-openshift-default-dockercfg-7k94x\""
Jul 20 14:06:02.080577 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.080541    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"]
Jul 20 14:06:02.184959 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.184917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dsgl\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-kube-api-access-4dsgl\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.184969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-certs\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.184993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-envoy\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.185008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istiod-ca-cert\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.185041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-credential-socket\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.185065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-token\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.185119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-podinfo\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185442 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.185208    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-data\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.185442 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.185262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-socket\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.285895 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.285856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-token\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286106 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.285904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-podinfo\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286106 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.285948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-data\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286106 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-socket\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286106 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsgl\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-kube-api-access-4dsgl\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286390 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-certs\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286390 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-envoy\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286390 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istiod-ca-cert\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286390 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-credential-socket\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286596 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-data\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286596 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286561    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-socket\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286596 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-certs\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.286735 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-credential-socket\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.287019 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.286994    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istiod-ca-cert\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.288657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.288637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-envoy\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.288747 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.288700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-podinfo\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.294689 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.294655    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dsgl\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-kube-api-access-4dsgl\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.294991 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.294967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-token\") pod \"e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") " pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.371153 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.371063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:02.515911 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.515884    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"]
Jul 20 14:06:02.518597 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:06:02.518568    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bd002d_3de7_4b4d_88cc_e9990d1fd8ef.slice/crio-93ca11f735b1f34c804588d87c7e721eb53ee98fe458144b98c91fd3272a9999 WatchSource:0}: Error finding container 93ca11f735b1f34c804588d87c7e721eb53ee98fe458144b98c91fd3272a9999: Status 404 returned error can't find the container with id 93ca11f735b1f34c804588d87c7e721eb53ee98fe458144b98c91fd3272a9999
Jul 20 14:06:02.520859 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.520825    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:02.520949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.520890    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:02.520949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:02.520922    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:03.375568 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:03.375531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" event={"ID":"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef","Type":"ContainerStarted","Data":"64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"}
Jul 20 14:06:03.375958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:03.375611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" event={"ID":"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef","Type":"ContainerStarted","Data":"93ca11f735b1f34c804588d87c7e721eb53ee98fe458144b98c91fd3272a9999"}
Jul 20 14:06:03.395607 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:03.395543    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" podStartSLOduration=1.395522876 podStartE2EDuration="1.395522876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:06:03.394974545 +0000 UTC m=+1668.670219076" watchObservedRunningTime="2026-07-20 14:06:03.395522876 +0000 UTC m=+1668.670767407"
Jul 20 14:06:04.371574 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.371538    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:04.377013 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.376988    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:04.380420 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.380395    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:04.381128 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.381114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:04.966356 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.966312    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"]
Jul 20 14:06:04.970023 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.970000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:04.973091 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.973069    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-35fa4021-serving-cert\""
Jul 20 14:06:04.979347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:04.979313    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"]
Jul 20 14:06:05.113876 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.113841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552fc5e3-d470-4d38-a9c0-d46bf7e67689-maas-api-tls\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.114069 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.113909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552fc5e3-d470-4d38-a9c0-d46bf7e67689-openshift-service-ca\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.114069 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.113969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbvsc\" (UniqueName: \"kubernetes.io/projected/552fc5e3-d470-4d38-a9c0-d46bf7e67689-kube-api-access-rbvsc\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.215027 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.214981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552fc5e3-d470-4d38-a9c0-d46bf7e67689-maas-api-tls\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.215258 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.215075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552fc5e3-d470-4d38-a9c0-d46bf7e67689-openshift-service-ca\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.215258 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.215109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvsc\" (UniqueName: \"kubernetes.io/projected/552fc5e3-d470-4d38-a9c0-d46bf7e67689-kube-api-access-rbvsc\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.215886 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.215818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552fc5e3-d470-4d38-a9c0-d46bf7e67689-openshift-service-ca\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.217765 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.217707    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552fc5e3-d470-4d38-a9c0-d46bf7e67689-maas-api-tls\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.224506 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.224481    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbvsc\" (UniqueName: \"kubernetes.io/projected/552fc5e3-d470-4d38-a9c0-d46bf7e67689-kube-api-access-rbvsc\") pod \"maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.282608 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.282566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:05.430426 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.430397    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"]
Jul 20 14:06:05.432591 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:06:05.432559    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552fc5e3_d470_4d38_a9c0_d46bf7e67689.slice/crio-d28bca5ac68dd9c195e707db2c713aa4ba2daa2cc96c54526e1f64fdbb76c502 WatchSource:0}: Error finding container d28bca5ac68dd9c195e707db2c713aa4ba2daa2cc96c54526e1f64fdbb76c502: Status 404 returned error can't find the container with id d28bca5ac68dd9c195e707db2c713aa4ba2daa2cc96c54526e1f64fdbb76c502
Jul 20 14:06:05.434071 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:05.434052    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 14:06:06.393908 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:06.393813    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb" event={"ID":"552fc5e3-d470-4d38-a9c0-d46bf7e67689","Type":"ContainerStarted","Data":"92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80"}
Jul 20 14:06:06.393908 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:06.393875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb" event={"ID":"552fc5e3-d470-4d38-a9c0-d46bf7e67689","Type":"ContainerStarted","Data":"d28bca5ac68dd9c195e707db2c713aa4ba2daa2cc96c54526e1f64fdbb76c502"}
Jul 20 14:06:06.393908 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:06.393905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:06.411587 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:06.411520    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb" podStartSLOduration=1.842763999 podStartE2EDuration="2.411500096s" totalImagesPullingTime="568.736097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:06:06.410317633 +0000 UTC m=+1671.685562162" watchObservedRunningTime="2026-07-20 14:06:06.411500096 +0000 UTC m=+1671.686744627"
Jul 20 14:06:12.413572 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:12.413528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:19.382337 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.382298    2559 patch_prober.go:28] interesting pod/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 20 14:06:19.382777 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.382356    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 20 14:06:19.465341 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.465311    2559 generic.go:356] "Generic (PLEG): container finished" podID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerID="64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4" exitCode=0
Jul 20 14:06:19.465532 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.465391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" event={"ID":"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef","Type":"ContainerDied","Data":"64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"}
Jul 20 14:06:19.465799 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.465784    2559 scope.go:117] "RemoveContainer" containerID="64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"
Jul 20 14:06:19.466795 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.466766    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:19.466863 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.466841    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:19.466899 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:19.466892    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:20.473589 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:20.473559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" event={"ID":"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef","Type":"ContainerStarted","Data":"bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c"}
Jul 20 14:06:21.371655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:21.371603    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:21.371849 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:21.371827    2559 patch_prober.go:28] interesting pod/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 20 14:06:21.371902 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:21.371875    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 20 14:06:22.371819 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:22.371782    2559 patch_prober.go:28] interesting pod/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 20 14:06:22.372257 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:22.371840    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 20 14:06:23.372400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:23.372360    2559 patch_prober.go:28] interesting pod/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 20 14:06:23.372807 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:23.372422    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 20 14:06:24.375550 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:24.375519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:24.375971 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:24.375892    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:24.376650 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:24.376634    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:30.575470 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.575432    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"]
Jul 20 14:06:30.579497 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.579476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:30.581924 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.581905    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:06:30.584966 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.584941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"]
Jul 20 14:06:30.651588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.651549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6\" (UID: \"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:30.752267 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.752227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6\" (UID: \"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:30.752887 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.752868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6\" (UID: \"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:30.891496 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:30.891392    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:31.034602 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:31.034577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"]
Jul 20 14:06:31.037503 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:06:31.037466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8f14f0_c37d_48b8_9623_6b1d4e9557d7.slice/crio-2cbd0cede336d17c456c7b8396f1a34c91c4bd68174ce7ec9494a5c4b71bcca2 WatchSource:0}: Error finding container 2cbd0cede336d17c456c7b8396f1a34c91c4bd68174ce7ec9494a5c4b71bcca2: Status 404 returned error can't find the container with id 2cbd0cede336d17c456c7b8396f1a34c91c4bd68174ce7ec9494a5c4b71bcca2
Jul 20 14:06:31.533799 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:31.533699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6" event={"ID":"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7","Type":"ContainerStarted","Data":"e935b3654812c15e16de12de0479be782c6fee0ae9d112bfa14c6523f5dcb2e7"}
Jul 20 14:06:31.533799 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:31.533762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6" event={"ID":"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7","Type":"ContainerStarted","Data":"2cbd0cede336d17c456c7b8396f1a34c91c4bd68174ce7ec9494a5c4b71bcca2"}
Jul 20 14:06:31.552636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:31.552580    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6" podStartSLOduration=1.5525639020000002 podStartE2EDuration="1.552563902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:06:31.550932417 +0000 UTC m=+1696.826176947" watchObservedRunningTime="2026-07-20 14:06:31.552563902 +0000 UTC m=+1696.827808504"
Jul 20 14:06:32.540578 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:32.540544    2559 generic.go:356] "Generic (PLEG): container finished" podID="5b8f14f0-c37d-48b8-9623-6b1d4e9557d7" containerID="e935b3654812c15e16de12de0479be782c6fee0ae9d112bfa14c6523f5dcb2e7" exitCode=0
Jul 20 14:06:32.541032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:32.540588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6" event={"ID":"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7","Type":"ContainerDied","Data":"e935b3654812c15e16de12de0479be782c6fee0ae9d112bfa14c6523f5dcb2e7"}
Jul 20 14:06:33.689033 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:33.689004    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:33.784458 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:33.784420    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7-maas-api-service-ca\") pod \"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7\" (UID: \"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7\") "
Jul 20 14:06:33.784790 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:33.784765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b8f14f0-c37d-48b8-9623-6b1d4e9557d7" (UID: "5b8f14f0-c37d-48b8-9623-6b1d4e9557d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:06:33.885456 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:33.885373    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7-maas-api-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:34.552096 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:34.552064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6" event={"ID":"5b8f14f0-c37d-48b8-9623-6b1d4e9557d7","Type":"ContainerDied","Data":"2cbd0cede336d17c456c7b8396f1a34c91c4bd68174ce7ec9494a5c4b71bcca2"}
Jul 20 14:06:34.552096 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:34.552088    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"
Jul 20 14:06:34.552096 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:34.552113    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cbd0cede336d17c456c7b8396f1a34c91c4bd68174ce7ec9494a5c4b71bcca2"
Jul 20 14:06:40.977388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:40.977301    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"]
Jul 20 14:06:40.977858 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:40.977530    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb" podUID="552fc5e3-d470-4d38-a9c0-d46bf7e67689" containerName="maas-api" containerID="cri-o://92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80" gracePeriod=30
Jul 20 14:06:41.231037 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.230968    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:41.358547 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.358510    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbvsc\" (UniqueName: \"kubernetes.io/projected/552fc5e3-d470-4d38-a9c0-d46bf7e67689-kube-api-access-rbvsc\") pod \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") "
Jul 20 14:06:41.358756 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.358559    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552fc5e3-d470-4d38-a9c0-d46bf7e67689-maas-api-tls\") pod \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") "
Jul 20 14:06:41.358756 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.358595    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552fc5e3-d470-4d38-a9c0-d46bf7e67689-openshift-service-ca\") pod \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\" (UID: \"552fc5e3-d470-4d38-a9c0-d46bf7e67689\") "
Jul 20 14:06:41.359064 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.359037    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552fc5e3-d470-4d38-a9c0-d46bf7e67689-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "552fc5e3-d470-4d38-a9c0-d46bf7e67689" (UID: "552fc5e3-d470-4d38-a9c0-d46bf7e67689"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:06:41.361012 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.360987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552fc5e3-d470-4d38-a9c0-d46bf7e67689-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "552fc5e3-d470-4d38-a9c0-d46bf7e67689" (UID: "552fc5e3-d470-4d38-a9c0-d46bf7e67689"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:06:41.361097 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.361010    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552fc5e3-d470-4d38-a9c0-d46bf7e67689-kube-api-access-rbvsc" (OuterVolumeSpecName: "kube-api-access-rbvsc") pod "552fc5e3-d470-4d38-a9c0-d46bf7e67689" (UID: "552fc5e3-d470-4d38-a9c0-d46bf7e67689"). InnerVolumeSpecName "kube-api-access-rbvsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:06:41.459630 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.459590    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbvsc\" (UniqueName: \"kubernetes.io/projected/552fc5e3-d470-4d38-a9c0-d46bf7e67689-kube-api-access-rbvsc\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:41.459630 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.459624    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552fc5e3-d470-4d38-a9c0-d46bf7e67689-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:41.459630 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.459633    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552fc5e3-d470-4d38-a9c0-d46bf7e67689-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:41.588256 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.588141    2559 generic.go:356] "Generic (PLEG): container finished" podID="552fc5e3-d470-4d38-a9c0-d46bf7e67689" containerID="92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80" exitCode=0
Jul 20 14:06:41.588256 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.588218    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"
Jul 20 14:06:41.588256 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.588230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb" event={"ID":"552fc5e3-d470-4d38-a9c0-d46bf7e67689","Type":"ContainerDied","Data":"92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80"}
Jul 20 14:06:41.588478 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.588296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb" event={"ID":"552fc5e3-d470-4d38-a9c0-d46bf7e67689","Type":"ContainerDied","Data":"d28bca5ac68dd9c195e707db2c713aa4ba2daa2cc96c54526e1f64fdbb76c502"}
Jul 20 14:06:41.588478 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.588320    2559 scope.go:117] "RemoveContainer" containerID="92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80"
Jul 20 14:06:41.598391 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.598361    2559 scope.go:117] "RemoveContainer" containerID="92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80"
Jul 20 14:06:41.598757 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:06:41.598729    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80\": container with ID starting with 92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80 not found: ID does not exist" containerID="92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80"
Jul 20 14:06:41.598860 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.598773    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80"} err="failed to get container status \"92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80\": rpc error: code = NotFound desc = could not find container \"92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80\": container with ID starting with 92483d3e239c77c8d0234c09031e697b2dba83700af5fc510324c9f7ca7bae80 not found: ID does not exist"
Jul 20 14:06:41.612169 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.612123    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"]
Jul 20 14:06:41.616083 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:41.616048    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-35fa4021-547cfbd44f-s2krb"]
Jul 20 14:06:43.193874 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:43.193830    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552fc5e3-d470-4d38-a9c0-d46bf7e67689" path="/var/lib/kubelet/pods/552fc5e3-d470-4d38-a9c0-d46bf7e67689/volumes"
Jul 20 14:06:45.674858 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:45.674823    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"]
Jul 20 14:06:45.676543 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:45.676523    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-35fa4021-tsbp6"]
Jul 20 14:06:45.831508 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:45.831468    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"]
Jul 20 14:06:45.831755 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:45.831728    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy" containerID="cri-o://bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c" gracePeriod=30
Jul 20 14:06:46.924027 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.923992    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"]
Jul 20 14:06:46.924434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.924382    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552fc5e3-d470-4d38-a9c0-d46bf7e67689" containerName="maas-api"
Jul 20 14:06:46.924434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.924394    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="552fc5e3-d470-4d38-a9c0-d46bf7e67689" containerName="maas-api"
Jul 20 14:06:46.924434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.924424    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8f14f0-c37d-48b8-9623-6b1d4e9557d7" containerName="revoke-keys"
Jul 20 14:06:46.924434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.924429    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8f14f0-c37d-48b8-9623-6b1d4e9557d7" containerName="revoke-keys"
Jul 20 14:06:46.924564 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.924486    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="552fc5e3-d470-4d38-a9c0-d46bf7e67689" containerName="maas-api"
Jul 20 14:06:46.924564 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.924497    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8f14f0-c37d-48b8-9623-6b1d4e9557d7" containerName="revoke-keys"
Jul 20 14:06:46.927378 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.927360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:46.930384 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.930362    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-56bba4d6-gw-openshift-default-dockercfg-m7t8b\""
Jul 20 14:06:46.941582 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:46.941555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"]
Jul 20 14:06:47.117550 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-token\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117742 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mltxz\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-kube-api-access-mltxz\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117742 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-data\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117742 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istiod-ca-cert\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117742 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-credential-socket\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117880 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-envoy\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117880 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-podinfo\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117962 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-socket\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.117962 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.117907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-certs\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.193710 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.193616    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b8f14f0-c37d-48b8-9623-6b1d4e9557d7" path="/var/lib/kubelet/pods/5b8f14f0-c37d-48b8-9623-6b1d4e9557d7/volumes"
Jul 20 14:06:47.219284 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219245    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istiod-ca-cert\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219487 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-credential-socket\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219487 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-envoy\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219487 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-podinfo\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219487 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-socket\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219487 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-certs\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219754 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-token\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219754 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mltxz\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-kube-api-access-mltxz\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.219754 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-data\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.220010 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.219984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-socket\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.220086 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.220017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-certs\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.220086 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.220072    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istiod-ca-cert\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.220193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.220151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-credential-socket\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.220283 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.220264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-data\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.221949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.221925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-envoy\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.222388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.222370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-podinfo\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.232256 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.232232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-token\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.232256 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.232243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mltxz\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-kube-api-access-mltxz\") pod \"e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") " pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.238214 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.238187    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:47.395003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.394974    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"]
Jul 20 14:06:47.397673 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:06:47.397636    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c0b29e_cb1d_4d73_ad7a_4bd4a0252e95.slice/crio-38395ad4af3d7a1ba460932e22d34880e9e39abdb55755e82858380a829f4e31 WatchSource:0}: Error finding container 38395ad4af3d7a1ba460932e22d34880e9e39abdb55755e82858380a829f4e31: Status 404 returned error can't find the container with id 38395ad4af3d7a1ba460932e22d34880e9e39abdb55755e82858380a829f4e31
Jul 20 14:06:47.400010 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.399973    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:47.400109 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.400042    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:47.400109 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.400072    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:06:47.622879 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.622843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" event={"ID":"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95","Type":"ContainerStarted","Data":"992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"}
Jul 20 14:06:47.623071 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.622903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" event={"ID":"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95","Type":"ContainerStarted","Data":"38395ad4af3d7a1ba460932e22d34880e9e39abdb55755e82858380a829f4e31"}
Jul 20 14:06:47.643287 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:47.643219    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podStartSLOduration=1.643196764 podStartE2EDuration="1.643196764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:06:47.64283488 +0000 UTC m=+1712.918079409" watchObservedRunningTime="2026-07-20 14:06:47.643196764 +0000 UTC m=+1712.918441294"
Jul 20 14:06:48.238685 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:48.238639    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:48.243922 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:48.243893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:48.629829 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:48.629748    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:48.630941 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:48.630923    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:06:49.224826 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.224787    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"]
Jul 20 14:06:49.228510 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.228492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.230878 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.230848    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-56bba4d6-serving-cert\""
Jul 20 14:06:49.239297 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.239272    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"]
Jul 20 14:06:49.340435 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.340395    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2b8t\" (UniqueName: \"kubernetes.io/projected/3779eafe-8d61-49ac-a851-93d06df1deb8-kube-api-access-g2b8t\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.340631 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.340514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.340631 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.340578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3779eafe-8d61-49ac-a851-93d06df1deb8-openshift-service-ca\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.441778 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.441734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.441778 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.441788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3779eafe-8d61-49ac-a851-93d06df1deb8-openshift-service-ca\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.442019 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.441825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2b8t\" (UniqueName: \"kubernetes.io/projected/3779eafe-8d61-49ac-a851-93d06df1deb8-kube-api-access-g2b8t\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.442019 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:06:49.441892    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-serving-cert: secret "maas-api-e2e-migrate-56bba4d6-serving-cert" not found
Jul 20 14:06:49.442019 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:06:49.441965    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls podName:3779eafe-8d61-49ac-a851-93d06df1deb8 nodeName:}" failed. No retries permitted until 2026-07-20 14:06:49.941948338 +0000 UTC m=+1715.217192845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls") pod "maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" (UID: "3779eafe-8d61-49ac-a851-93d06df1deb8") : secret "maas-api-e2e-migrate-56bba4d6-serving-cert" not found
Jul 20 14:06:49.442490 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.442473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3779eafe-8d61-49ac-a851-93d06df1deb8-openshift-service-ca\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.451303 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.451277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2b8t\" (UniqueName: \"kubernetes.io/projected/3779eafe-8d61-49ac-a851-93d06df1deb8-kube-api-access-g2b8t\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.947549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.947510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:49.950141 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:49.950110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls\") pod \"maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:50.142835 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:50.142796    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:50.288824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:50.288763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"]
Jul 20 14:06:50.291754 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:06:50.291710    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3779eafe_8d61_49ac_a851_93d06df1deb8.slice/crio-4c96a6640f82a239fb958b3a6dcaa29765b90fe0afd5bdd75c300a22aa8ae2b9 WatchSource:0}: Error finding container 4c96a6640f82a239fb958b3a6dcaa29765b90fe0afd5bdd75c300a22aa8ae2b9: Status 404 returned error can't find the container with id 4c96a6640f82a239fb958b3a6dcaa29765b90fe0afd5bdd75c300a22aa8ae2b9
Jul 20 14:06:50.642035 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:50.642005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" event={"ID":"3779eafe-8d61-49ac-a851-93d06df1deb8","Type":"ContainerStarted","Data":"4c96a6640f82a239fb958b3a6dcaa29765b90fe0afd5bdd75c300a22aa8ae2b9"}
Jul 20 14:06:51.090577 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.090546    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:51.160743 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160711    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-socket\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160743 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160748    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-certs\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-credential-socket\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160788    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-podinfo\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160827    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-token\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160846    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-data\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160890    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istiod-ca-cert\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160925    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-envoy\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.160978 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.160964    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dsgl\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-kube-api-access-4dsgl\") pod \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\" (UID: \"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef\") "
Jul 20 14:06:51.161374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:06:51.161374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:06:51.161374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:06:51.161374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161370    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.161579 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161386    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.161579 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161407    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.161579 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161460    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:06:51.161900 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.161876    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:06:51.163366 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.163339    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:06:51.163484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.163468    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:06:51.163803 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.163779    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:06:51.163941 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.163848    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-kube-api-access-4dsgl" (OuterVolumeSpecName: "kube-api-access-4dsgl") pod "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" (UID: "22bd002d-3de7-4b4d-88cc-e9990d1fd8ef"). InnerVolumeSpecName "kube-api-access-4dsgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:06:51.262636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.262590    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.262636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.262624    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.262636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.262633    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dsgl\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-kube-api-access-4dsgl\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.262636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.262641    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.262907 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.262650    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.262907 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.262658    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:06:51.649178 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.649122    2559 generic.go:356] "Generic (PLEG): container finished" podID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerID="bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c" exitCode=0
Jul 20 14:06:51.649610 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.649212    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"
Jul 20 14:06:51.649610 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.649208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" event={"ID":"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef","Type":"ContainerDied","Data":"bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c"}
Jul 20 14:06:51.649610 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.649358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn" event={"ID":"22bd002d-3de7-4b4d-88cc-e9990d1fd8ef","Type":"ContainerDied","Data":"93ca11f735b1f34c804588d87c7e721eb53ee98fe458144b98c91fd3272a9999"}
Jul 20 14:06:51.649610 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.649396    2559 scope.go:117] "RemoveContainer" containerID="bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c"
Jul 20 14:06:51.650998 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.650978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" event={"ID":"3779eafe-8d61-49ac-a851-93d06df1deb8","Type":"ContainerStarted","Data":"adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f"}
Jul 20 14:06:51.651126 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.651109    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:51.659123 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.659102    2559 scope.go:117] "RemoveContainer" containerID="64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"
Jul 20 14:06:51.668316 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.668290    2559 scope.go:117] "RemoveContainer" containerID="bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c"
Jul 20 14:06:51.668602 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:06:51.668584    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c\": container with ID starting with bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c not found: ID does not exist" containerID="bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c"
Jul 20 14:06:51.668659 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.668616    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c"} err="failed to get container status \"bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c\": rpc error: code = NotFound desc = could not find container \"bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c\": container with ID starting with bf25b8e33dd367414360e259cd30efb857f5aa7925d9629452073a805e9d2f4c not found: ID does not exist"
Jul 20 14:06:51.668659 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.668634    2559 scope.go:117] "RemoveContainer" containerID="64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"
Jul 20 14:06:51.668901 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:06:51.668883    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4\": container with ID starting with 64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4 not found: ID does not exist" containerID="64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"
Jul 20 14:06:51.668965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.668910    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4"} err="failed to get container status \"64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4\": rpc error: code = NotFound desc = could not find container \"64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4\": container with ID starting with 64da352756e7fdd8525b974c9bac45a0d497519ccb7437c6f8447707c9ae04c4 not found: ID does not exist"
Jul 20 14:06:51.669455 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.669437    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"]
Jul 20 14:06:51.672886 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:51.672865    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-35fa4021-openshift-default-675d5fdb9f-d8zhn"]
Jul 20 14:06:53.193497 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:53.193458    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" path="/var/lib/kubelet/pods/22bd002d-3de7-4b4d-88cc-e9990d1fd8ef/volumes"
Jul 20 14:06:57.669702 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:57.669673    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:06:57.693681 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:06:57.693598    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" podStartSLOduration=8.363077706 podStartE2EDuration="8.693577211s" totalImagesPullingTime="330.499505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:06:51.689684184 +0000 UTC m=+1716.964928713" watchObservedRunningTime="2026-07-20 14:06:57.693577211 +0000 UTC m=+1722.968821741"
Jul 20 14:07:03.631848 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.631750    2559 patch_prober.go:28] interesting pod/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 20 14:07:03.631848 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.631805    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 20 14:07:03.727928 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.727894    2559 generic.go:356] "Generic (PLEG): container finished" podID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerID="992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57" exitCode=0
Jul 20 14:07:03.728094 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.727942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" event={"ID":"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95","Type":"ContainerDied","Data":"992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"}
Jul 20 14:07:03.728368 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.728353    2559 scope.go:117] "RemoveContainer" containerID="992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"
Jul 20 14:07:03.729388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.729359    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:03.729442 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.729427    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:03.729476 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:03.729459    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:04.734742 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:04.734705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" event={"ID":"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95","Type":"ContainerStarted","Data":"8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696"}
Jul 20 14:07:05.239228 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:05.239187    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:07:05.239501 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:05.239478    2559 patch_prober.go:28] interesting pod/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 20 14:07:05.239563 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:05.239543    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 20 14:07:06.239505 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:06.239461    2559 patch_prober.go:28] interesting pod/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 20 14:07:06.239897 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:06.239520    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 20 14:07:07.239200 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:07.239147    2559 patch_prober.go:28] interesting pod/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 20 14:07:07.239389 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:07.239228    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 20 14:07:08.238788 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:08.238745    2559 patch_prober.go:28] interesting pod/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 20 14:07:08.239243 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:08.238807    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 20 14:07:09.243113 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:09.243083    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:07:09.243531 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:09.243363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:07:09.244209 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:09.244194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:07:14.214609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.214572    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"]
Jul 20 14:07:14.215001 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.214977    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy"
Jul 20 14:07:14.215001 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.214990    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy"
Jul 20 14:07:14.215001 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.215003    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy"
Jul 20 14:07:14.215103 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.215009    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy"
Jul 20 14:07:14.215103 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.215083    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy"
Jul 20 14:07:14.215103 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.215093    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="22bd002d-3de7-4b4d-88cc-e9990d1fd8ef" containerName="istio-proxy"
Jul 20 14:07:14.217298 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.217279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:14.220146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.220117    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:07:14.226838 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.226810    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"]
Jul 20 14:07:14.291132 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.291092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b17659-5e71-43e4-bcab-08a2558eb0b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz\" (UID: \"b7b17659-5e71-43e4-bcab-08a2558eb0b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:14.392135 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.392094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b17659-5e71-43e4-bcab-08a2558eb0b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz\" (UID: \"b7b17659-5e71-43e4-bcab-08a2558eb0b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:14.392803 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.392780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b17659-5e71-43e4-bcab-08a2558eb0b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz\" (UID: \"b7b17659-5e71-43e4-bcab-08a2558eb0b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:14.529205 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.529078    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:14.671799 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.671763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"]
Jul 20 14:07:14.674149 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:07:14.674122    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b17659_5e71_43e4_bcab_08a2558eb0b5.slice/crio-1b85449cf5beb4a424b8eed332c1bd7db991cb5ca411f8b925a10d3e7d6f3d05 WatchSource:0}: Error finding container 1b85449cf5beb4a424b8eed332c1bd7db991cb5ca411f8b925a10d3e7d6f3d05: Status 404 returned error can't find the container with id 1b85449cf5beb4a424b8eed332c1bd7db991cb5ca411f8b925a10d3e7d6f3d05
Jul 20 14:07:14.790898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:14.790802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz" event={"ID":"b7b17659-5e71-43e4-bcab-08a2558eb0b5","Type":"ContainerStarted","Data":"1b85449cf5beb4a424b8eed332c1bd7db991cb5ca411f8b925a10d3e7d6f3d05"}
Jul 20 14:07:15.797548 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:15.797454    2559 generic.go:356] "Generic (PLEG): container finished" podID="b7b17659-5e71-43e4-bcab-08a2558eb0b5" containerID="76f843fb579d701642d1f2f002fa0ce9340fd21b39b470fc63efefa10996e616" exitCode=0
Jul 20 14:07:15.797548 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:15.797509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz" event={"ID":"b7b17659-5e71-43e4-bcab-08a2558eb0b5","Type":"ContainerDied","Data":"76f843fb579d701642d1f2f002fa0ce9340fd21b39b470fc63efefa10996e616"}
Jul 20 14:07:16.939366 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:16.939341    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:17.020734 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:17.020698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b17659-5e71-43e4-bcab-08a2558eb0b5-maas-api-service-ca\") pod \"b7b17659-5e71-43e4-bcab-08a2558eb0b5\" (UID: \"b7b17659-5e71-43e4-bcab-08a2558eb0b5\") "
Jul 20 14:07:17.021076 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:17.021053    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b17659-5e71-43e4-bcab-08a2558eb0b5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b7b17659-5e71-43e4-bcab-08a2558eb0b5" (UID: "b7b17659-5e71-43e4-bcab-08a2558eb0b5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:07:17.121586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:17.121495    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b17659-5e71-43e4-bcab-08a2558eb0b5-maas-api-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:17.808921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:17.808893    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"
Jul 20 14:07:17.809104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:17.808880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz" event={"ID":"b7b17659-5e71-43e4-bcab-08a2558eb0b5","Type":"ContainerDied","Data":"1b85449cf5beb4a424b8eed332c1bd7db991cb5ca411f8b925a10d3e7d6f3d05"}
Jul 20 14:07:17.809104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:17.809014    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b85449cf5beb4a424b8eed332c1bd7db991cb5ca411f8b925a10d3e7d6f3d05"
Jul 20 14:07:24.836838 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:24.836787    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"]
Jul 20 14:07:24.837344 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:24.837126    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" podUID="3779eafe-8d61-49ac-a851-93d06df1deb8" containerName="maas-api" containerID="cri-o://adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f" gracePeriod=30
Jul 20 14:07:25.103150 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.103077    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:07:25.298192 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.298119    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls\") pod \"3779eafe-8d61-49ac-a851-93d06df1deb8\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") "
Jul 20 14:07:25.298399 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.298238    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3779eafe-8d61-49ac-a851-93d06df1deb8-openshift-service-ca\") pod \"3779eafe-8d61-49ac-a851-93d06df1deb8\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") "
Jul 20 14:07:25.298399 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.298333    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2b8t\" (UniqueName: \"kubernetes.io/projected/3779eafe-8d61-49ac-a851-93d06df1deb8-kube-api-access-g2b8t\") pod \"3779eafe-8d61-49ac-a851-93d06df1deb8\" (UID: \"3779eafe-8d61-49ac-a851-93d06df1deb8\") "
Jul 20 14:07:25.298741 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.298699    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3779eafe-8d61-49ac-a851-93d06df1deb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3779eafe-8d61-49ac-a851-93d06df1deb8" (UID: "3779eafe-8d61-49ac-a851-93d06df1deb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:07:25.300591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.300563    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3779eafe-8d61-49ac-a851-93d06df1deb8" (UID: "3779eafe-8d61-49ac-a851-93d06df1deb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:07:25.300717 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.300686    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3779eafe-8d61-49ac-a851-93d06df1deb8-kube-api-access-g2b8t" (OuterVolumeSpecName: "kube-api-access-g2b8t") pod "3779eafe-8d61-49ac-a851-93d06df1deb8" (UID: "3779eafe-8d61-49ac-a851-93d06df1deb8"). InnerVolumeSpecName "kube-api-access-g2b8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:07:25.399664 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.399631    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3779eafe-8d61-49ac-a851-93d06df1deb8-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:25.399831 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.399688    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3779eafe-8d61-49ac-a851-93d06df1deb8-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:25.399831 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.399698    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2b8t\" (UniqueName: \"kubernetes.io/projected/3779eafe-8d61-49ac-a851-93d06df1deb8-kube-api-access-g2b8t\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:25.852652 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.852569    2559 generic.go:356] "Generic (PLEG): container finished" podID="3779eafe-8d61-49ac-a851-93d06df1deb8" containerID="adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f" exitCode=0
Jul 20 14:07:25.852652 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.852642    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"
Jul 20 14:07:25.853135 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.852658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" event={"ID":"3779eafe-8d61-49ac-a851-93d06df1deb8","Type":"ContainerDied","Data":"adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f"}
Jul 20 14:07:25.853135 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.852729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t" event={"ID":"3779eafe-8d61-49ac-a851-93d06df1deb8","Type":"ContainerDied","Data":"4c96a6640f82a239fb958b3a6dcaa29765b90fe0afd5bdd75c300a22aa8ae2b9"}
Jul 20 14:07:25.853135 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.852754    2559 scope.go:117] "RemoveContainer" containerID="adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f"
Jul 20 14:07:25.862880 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.862856    2559 scope.go:117] "RemoveContainer" containerID="adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f"
Jul 20 14:07:25.863128 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:07:25.863109    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f\": container with ID starting with adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f not found: ID does not exist" containerID="adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f"
Jul 20 14:07:25.863204 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.863138    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f"} err="failed to get container status \"adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f\": rpc error: code = NotFound desc = could not find container \"adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f\": container with ID starting with adab22b16edea5146bd814cb66e2d916c09c29a07f31663eb44f0edef2ad328f not found: ID does not exist"
Jul 20 14:07:25.878711 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.878677    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"]
Jul 20 14:07:25.881864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:25.881840    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-56bba4d6-66bf6bd6f6-hmm8t"]
Jul 20 14:07:27.193688 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:27.193658    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3779eafe-8d61-49ac-a851-93d06df1deb8" path="/var/lib/kubelet/pods/3779eafe-8d61-49ac-a851-93d06df1deb8/volumes"
Jul 20 14:07:29.311528 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:29.311490    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"]
Jul 20 14:07:29.314355 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:29.314326    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-56bba4d6-n8tbz"]
Jul 20 14:07:29.450575 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:29.450536    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"]
Jul 20 14:07:29.450815 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:29.450790    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy" containerID="cri-o://8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696" gracePeriod=30
Jul 20 14:07:30.286180 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.286065    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"]
Jul 20 14:07:30.286970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.286935    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b17659-5e71-43e4-bcab-08a2558eb0b5" containerName="revoke-keys"
Jul 20 14:07:30.286970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.286970    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b17659-5e71-43e4-bcab-08a2558eb0b5" containerName="revoke-keys"
Jul 20 14:07:30.287228 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.287028    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3779eafe-8d61-49ac-a851-93d06df1deb8" containerName="maas-api"
Jul 20 14:07:30.287228 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.287038    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3779eafe-8d61-49ac-a851-93d06df1deb8" containerName="maas-api"
Jul 20 14:07:30.287343 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.287268    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3779eafe-8d61-49ac-a851-93d06df1deb8" containerName="maas-api"
Jul 20 14:07:30.287343 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.287292    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b17659-5e71-43e4-bcab-08a2558eb0b5" containerName="revoke-keys"
Jul 20 14:07:30.293297 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.293266    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.295792 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.295763    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a4b70e6d-openshift-default-dockercfg-2jss6\""
Jul 20 14:07:30.299729 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.299693    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"]
Jul 20 14:07:30.337853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.337811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-socket\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.337853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.337852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-certs\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.337869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5132e68-2506-4aec-963f-664861178a94-istio-podinfo\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.337945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-credential-socket\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.338004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-istio-token\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.338047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5132e68-2506-4aec-963f-664861178a94-istiod-ca-cert\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.338064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9kh5\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-kube-api-access-s9kh5\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.338121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-envoy\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.338360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.338185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-data\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.438725 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-credential-socket\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.438953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-istio-token\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.438953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5132e68-2506-4aec-963f-664861178a94-istiod-ca-cert\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.438953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9kh5\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-kube-api-access-s9kh5\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.438953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-envoy\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.438953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-data\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439269 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-socket\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439269 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.438986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-certs\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439269 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.439017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5132e68-2506-4aec-963f-664861178a94-istio-podinfo\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439269 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.439227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-credential-socket\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439522 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.439491    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-socket\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439585 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.439547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5132e68-2506-4aec-963f-664861178a94-istiod-ca-cert\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.439597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-certs\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.439789 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.439734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-data\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.441393 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.441371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-envoy\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.441591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.441574    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5132e68-2506-4aec-963f-664861178a94-istio-podinfo\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.446954 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.446935    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-istio-token\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.447593 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.447575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9kh5\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-kube-api-access-s9kh5\") pod \"e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") " pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.607265 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.607138    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:30.769741 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.769708    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"]
Jul 20 14:07:30.773340 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:07:30.773310    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5132e68_2506_4aec_963f_664861178a94.slice/crio-0e82e60aa723be706ad2fe7cad70cea2a7ab495266074b24eb4f37ac2c9e96b8 WatchSource:0}: Error finding container 0e82e60aa723be706ad2fe7cad70cea2a7ab495266074b24eb4f37ac2c9e96b8: Status 404 returned error can't find the container with id 0e82e60aa723be706ad2fe7cad70cea2a7ab495266074b24eb4f37ac2c9e96b8
Jul 20 14:07:30.775800 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.775763    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:30.775901 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.775834    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:30.775901 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.775864    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:30.880865 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.880772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" event={"ID":"e5132e68-2506-4aec-963f-664861178a94","Type":"ContainerStarted","Data":"2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"}
Jul 20 14:07:30.880865 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.880824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" event={"ID":"e5132e68-2506-4aec-963f-664861178a94","Type":"ContainerStarted","Data":"0e82e60aa723be706ad2fe7cad70cea2a7ab495266074b24eb4f37ac2c9e96b8"}
Jul 20 14:07:30.903695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:30.903646    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podStartSLOduration=0.903631192 podStartE2EDuration="903.631192ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:07:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:07:30.903483556 +0000 UTC m=+1756.178728086" watchObservedRunningTime="2026-07-20 14:07:30.903631192 +0000 UTC m=+1756.178875720"
Jul 20 14:07:31.194341 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:31.194300    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7b17659-5e71-43e4-bcab-08a2558eb0b5" path="/var/lib/kubelet/pods/b7b17659-5e71-43e4-bcab-08a2558eb0b5/volumes"
Jul 20 14:07:31.607902 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:31.607817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:31.612918 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:31.612881    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:31.885734 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:31.885648    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:31.886827 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:31.886804    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:32.586789 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.586760    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"]
Jul 20 14:07:32.589664 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.589648    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.592151 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.592128    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a4b70e6d-serving-cert\""
Jul 20 14:07:32.603248 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.603221    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"]
Jul 20 14:07:32.656521 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.656486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8e5b1e-00f5-427e-af25-01eda802ac59-openshift-service-ca\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.656898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.656581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569h7\" (UniqueName: \"kubernetes.io/projected/2b8e5b1e-00f5-427e-af25-01eda802ac59-kube-api-access-569h7\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.656898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.656619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.757319 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.757279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8e5b1e-00f5-427e-af25-01eda802ac59-openshift-service-ca\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.757524 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.757367    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569h7\" (UniqueName: \"kubernetes.io/projected/2b8e5b1e-00f5-427e-af25-01eda802ac59-kube-api-access-569h7\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.757524 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.757415    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.757648 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:07:32.757539    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-serving-cert: secret "maas-api-e2e-ait-a4b70e6d-serving-cert" not found
Jul 20 14:07:32.757648 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:07:32.757609    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls podName:2b8e5b1e-00f5-427e-af25-01eda802ac59 nodeName:}" failed. No retries permitted until 2026-07-20 14:07:33.257588486 +0000 UTC m=+1758.532832995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls") pod "maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" (UID: "2b8e5b1e-00f5-427e-af25-01eda802ac59") : secret "maas-api-e2e-ait-a4b70e6d-serving-cert" not found
Jul 20 14:07:32.757951 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.757930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8e5b1e-00f5-427e-af25-01eda802ac59-openshift-service-ca\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:32.767148 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:32.767116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-569h7\" (UniqueName: \"kubernetes.io/projected/2b8e5b1e-00f5-427e-af25-01eda802ac59-kube-api-access-569h7\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:33.261610 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:33.261564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:33.264172 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:33.264127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls\") pod \"maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:33.501370 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:33.501329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:33.672328 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:33.672303    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"]
Jul 20 14:07:33.674481 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:07:33.674453    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8e5b1e_00f5_427e_af25_01eda802ac59.slice/crio-e49df536da51eae081a8e06c80f5ebd435239278fe0aecc7b55e04c4f8ed80d8 WatchSource:0}: Error finding container e49df536da51eae081a8e06c80f5ebd435239278fe0aecc7b55e04c4f8ed80d8: Status 404 returned error can't find the container with id e49df536da51eae081a8e06c80f5ebd435239278fe0aecc7b55e04c4f8ed80d8
Jul 20 14:07:33.899715 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:33.899673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" event={"ID":"2b8e5b1e-00f5-427e-af25-01eda802ac59","Type":"ContainerStarted","Data":"e49df536da51eae081a8e06c80f5ebd435239278fe0aecc7b55e04c4f8ed80d8"}
Jul 20 14:07:34.707446 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.707422    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:07:34.773187 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773121    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mltxz\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-kube-api-access-mltxz\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773187 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773187    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-credential-socket\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773223    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-certs\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773257    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-envoy\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773288    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-data\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istiod-ca-cert\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773345    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-podinfo\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773658 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773417    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-socket\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773658 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-token\") pod \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\" (UID: \"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95\") "
Jul 20 14:07:34.773658 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773531    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:07:34.773658 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773539    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:07:34.773866 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773773    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:07:34.773921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773875    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.773921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773897    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.773921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.773913    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.774325 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.774248    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:07:34.774545 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.774525    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-data" (OuterVolumeSpecName: "istio-data") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:07:34.775574 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.775553    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-kube-api-access-mltxz" (OuterVolumeSpecName: "kube-api-access-mltxz") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "kube-api-access-mltxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:07:34.775790 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.775774    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-token" (OuterVolumeSpecName: "istio-token") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:07:34.776215 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.776190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:07:34.776428 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.776351    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" (UID: "79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:07:34.875032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.874943    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mltxz\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-kube-api-access-mltxz\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.875032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.874975    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.875032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.874984    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.875032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.874994    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.875032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.875003    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.875032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.875011    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:07:34.907628 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.907573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" event={"ID":"2b8e5b1e-00f5-427e-af25-01eda802ac59","Type":"ContainerStarted","Data":"192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba"}
Jul 20 14:07:34.907832 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.907771    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:34.909277 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.909252    2559 generic.go:356] "Generic (PLEG): container finished" podID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerID="8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696" exitCode=0
Jul 20 14:07:34.909401 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.909297    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"
Jul 20 14:07:34.909401 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.909330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" event={"ID":"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95","Type":"ContainerDied","Data":"8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696"}
Jul 20 14:07:34.909401 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.909379    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97" event={"ID":"79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95","Type":"ContainerDied","Data":"38395ad4af3d7a1ba460932e22d34880e9e39abdb55755e82858380a829f4e31"}
Jul 20 14:07:34.909401 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.909400    2559 scope.go:117] "RemoveContainer" containerID="8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696"
Jul 20 14:07:34.918720 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.918698    2559 scope.go:117] "RemoveContainer" containerID="992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"
Jul 20 14:07:34.926824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.926808    2559 scope.go:117] "RemoveContainer" containerID="8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696"
Jul 20 14:07:34.927085 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:07:34.927064    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696\": container with ID starting with 8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696 not found: ID does not exist" containerID="8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696"
Jul 20 14:07:34.927152 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.927099    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696"} err="failed to get container status \"8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696\": rpc error: code = NotFound desc = could not find container \"8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696\": container with ID starting with 8dde8e17fe29c08f8d254b8ed8b512c9ee7133257dc60e375f44df69dad43696 not found: ID does not exist"
Jul 20 14:07:34.927152 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.927127    2559 scope.go:117] "RemoveContainer" containerID="992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"
Jul 20 14:07:34.927430 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:07:34.927410    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57\": container with ID starting with 992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57 not found: ID does not exist" containerID="992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"
Jul 20 14:07:34.927474 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.927436    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57"} err="failed to get container status \"992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57\": rpc error: code = NotFound desc = could not find container \"992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57\": container with ID starting with 992121541b739b10dc5ca3a2eb5a8a9445b5c1294a4acf89b0eb0aed95a0fd57 not found: ID does not exist"
Jul 20 14:07:34.942758 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.942707    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" podStartSLOduration=2.368936213 podStartE2EDuration="2.942694037s" totalImagesPullingTime="573.757824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:07:34.940794788 +0000 UTC m=+1760.216039317" watchObservedRunningTime="2026-07-20 14:07:34.942694037 +0000 UTC m=+1760.217938566"
Jul 20 14:07:34.968283 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.968255    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"]
Jul 20 14:07:34.972871 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:34.972847    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-56bba4d6-gw-openshift-default-7d64b6bd8c-2cr97"]
Jul 20 14:07:35.194400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:35.194365    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" path="/var/lib/kubelet/pods/79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95/volumes"
Jul 20 14:07:40.923014 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:40.922986    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:07:47.272305 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.271893    2559 patch_prober.go:28] interesting pod/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:54544->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Jul 20 14:07:47.272305 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.272002    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:54544->10.132.0.54:15021: read: connection reset by peer"
Jul 20 14:07:47.981348 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.981313    2559 generic.go:356] "Generic (PLEG): container finished" podID="e5132e68-2506-4aec-963f-664861178a94" containerID="2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813" exitCode=0
Jul 20 14:07:47.981528 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.981387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" event={"ID":"e5132e68-2506-4aec-963f-664861178a94","Type":"ContainerDied","Data":"2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"}
Jul 20 14:07:47.981831 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.981816    2559 scope.go:117] "RemoveContainer" containerID="2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"
Jul 20 14:07:47.982845 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.982818    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:47.982900 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.982883    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:47.982935 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:47.982914    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:07:48.988356 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:48.988316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" event={"ID":"e5132e68-2506-4aec-963f-664861178a94","Type":"ContainerStarted","Data":"177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a"}
Jul 20 14:07:49.607670 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:49.607629    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:49.608238 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:49.608206    2559 patch_prober.go:28] interesting pod/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 14:07:49.608491 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:49.608455    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 14:07:50.608186 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:50.608114    2559 patch_prober.go:28] interesting pod/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 14:07:50.608804 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:50.608763    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 14:07:51.607882 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:51.607837    2559 patch_prober.go:28] interesting pod/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 14:07:51.608277 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:51.608236    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 14:07:52.607770 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:52.607717    2559 patch_prober.go:28] interesting pod/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 14:07:52.608002 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:52.607809    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 14:07:53.611232 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:53.611200    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:53.611640 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:53.611588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:53.612287 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:53.612267    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:07:58.202350 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202312    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"]
Jul 20 14:07:58.202746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202704    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy"
Jul 20 14:07:58.202746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202717    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy"
Jul 20 14:07:58.202746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202726    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy"
Jul 20 14:07:58.202746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202732    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy"
Jul 20 14:07:58.202874 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202800    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy"
Jul 20 14:07:58.202874 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.202807    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c0b29e-cb1d-4d73-ad7a-4bd4a0252e95" containerName="istio-proxy"
Jul 20 14:07:58.204758 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.204740    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:07:58.208070 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.208050    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:07:58.216669 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.216630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"]
Jul 20 14:07:58.290260 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.290204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8ab064-c932-432c-a994-6397691f0b17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb\" (UID: \"eb8ab064-c932-432c-a994-6397691f0b17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:07:58.391036 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.390991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8ab064-c932-432c-a994-6397691f0b17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb\" (UID: \"eb8ab064-c932-432c-a994-6397691f0b17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:07:58.391643 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.391624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8ab064-c932-432c-a994-6397691f0b17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb\" (UID: \"eb8ab064-c932-432c-a994-6397691f0b17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:07:58.515697 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.515607    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:07:58.675941 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:58.675909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"]
Jul 20 14:07:58.677394 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:07:58.677366    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8ab064_c932_432c_a994_6397691f0b17.slice/crio-c263f1db399a1d183a0320c4bc4dadb7a63957d231e9526b1cfbe81473d78c7d WatchSource:0}: Error finding container c263f1db399a1d183a0320c4bc4dadb7a63957d231e9526b1cfbe81473d78c7d: Status 404 returned error can't find the container with id c263f1db399a1d183a0320c4bc4dadb7a63957d231e9526b1cfbe81473d78c7d
Jul 20 14:07:59.058418 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:59.058385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb" event={"ID":"eb8ab064-c932-432c-a994-6397691f0b17","Type":"ContainerStarted","Data":"a80a4ec04721daef3f77b727121c3c62427385677db28df3d84868b7e385165a"}
Jul 20 14:07:59.058598 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:59.058447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb" event={"ID":"eb8ab064-c932-432c-a994-6397691f0b17","Type":"ContainerStarted","Data":"c263f1db399a1d183a0320c4bc4dadb7a63957d231e9526b1cfbe81473d78c7d"}
Jul 20 14:07:59.073898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:07:59.073845    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb" podStartSLOduration=1.07383064 podStartE2EDuration="1.07383064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:07:59.072847034 +0000 UTC m=+1784.348091562" watchObservedRunningTime="2026-07-20 14:07:59.07383064 +0000 UTC m=+1784.349075169"
Jul 20 14:08:00.064531 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:00.064497    2559 generic.go:356] "Generic (PLEG): container finished" podID="eb8ab064-c932-432c-a994-6397691f0b17" containerID="a80a4ec04721daef3f77b727121c3c62427385677db28df3d84868b7e385165a" exitCode=0
Jul 20 14:08:00.065053 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:00.064568    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb" event={"ID":"eb8ab064-c932-432c-a994-6397691f0b17","Type":"ContainerDied","Data":"a80a4ec04721daef3f77b727121c3c62427385677db28df3d84868b7e385165a"}
Jul 20 14:08:01.211116 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:01.211088    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:08:01.319028 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:01.318976    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8ab064-c932-432c-a994-6397691f0b17-maas-api-service-ca\") pod \"eb8ab064-c932-432c-a994-6397691f0b17\" (UID: \"eb8ab064-c932-432c-a994-6397691f0b17\") "
Jul 20 14:08:01.319377 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:01.319355    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8ab064-c932-432c-a994-6397691f0b17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb8ab064-c932-432c-a994-6397691f0b17" (UID: "eb8ab064-c932-432c-a994-6397691f0b17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:08:01.420024 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:01.419986    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8ab064-c932-432c-a994-6397691f0b17-maas-api-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:02.077003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:02.076974    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"
Jul 20 14:08:02.077003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:02.076976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb" event={"ID":"eb8ab064-c932-432c-a994-6397691f0b17","Type":"ContainerDied","Data":"c263f1db399a1d183a0320c4bc4dadb7a63957d231e9526b1cfbe81473d78c7d"}
Jul 20 14:08:02.077260 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:02.077031    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c263f1db399a1d183a0320c4bc4dadb7a63957d231e9526b1cfbe81473d78c7d"
Jul 20 14:08:08.808493 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:08.808288    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"]
Jul 20 14:08:08.808947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:08.808598    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" podUID="2b8e5b1e-00f5-427e-af25-01eda802ac59" containerName="maas-api" containerID="cri-o://192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba" gracePeriod=30
Jul 20 14:08:09.060625 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.060559    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:08:09.113866 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.113831    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b8e5b1e-00f5-427e-af25-01eda802ac59" containerID="192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba" exitCode=0
Jul 20 14:08:09.114040 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.113881    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"
Jul 20 14:08:09.114040 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.113910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" event={"ID":"2b8e5b1e-00f5-427e-af25-01eda802ac59","Type":"ContainerDied","Data":"192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba"}
Jul 20 14:08:09.114040 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.113953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6" event={"ID":"2b8e5b1e-00f5-427e-af25-01eda802ac59","Type":"ContainerDied","Data":"e49df536da51eae081a8e06c80f5ebd435239278fe0aecc7b55e04c4f8ed80d8"}
Jul 20 14:08:09.114040 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.113973    2559 scope.go:117] "RemoveContainer" containerID="192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba"
Jul 20 14:08:09.122828 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.122804    2559 scope.go:117] "RemoveContainer" containerID="192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba"
Jul 20 14:08:09.123120 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:08:09.123103    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba\": container with ID starting with 192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba not found: ID does not exist" containerID="192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba"
Jul 20 14:08:09.123211 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.123129    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba"} err="failed to get container status \"192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba\": rpc error: code = NotFound desc = could not find container \"192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba\": container with ID starting with 192b579875ed8cddfb0e08b902a42afecba9ba4caad4d0b8f93ad85666e301ba not found: ID does not exist"
Jul 20 14:08:09.193563 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.193534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls\") pod \"2b8e5b1e-00f5-427e-af25-01eda802ac59\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") "
Jul 20 14:08:09.193746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.193642    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-569h7\" (UniqueName: \"kubernetes.io/projected/2b8e5b1e-00f5-427e-af25-01eda802ac59-kube-api-access-569h7\") pod \"2b8e5b1e-00f5-427e-af25-01eda802ac59\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") "
Jul 20 14:08:09.193746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.193702    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8e5b1e-00f5-427e-af25-01eda802ac59-openshift-service-ca\") pod \"2b8e5b1e-00f5-427e-af25-01eda802ac59\" (UID: \"2b8e5b1e-00f5-427e-af25-01eda802ac59\") "
Jul 20 14:08:09.194297 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.194262    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b8e5b1e-00f5-427e-af25-01eda802ac59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b8e5b1e-00f5-427e-af25-01eda802ac59" (UID: "2b8e5b1e-00f5-427e-af25-01eda802ac59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:08:09.196330 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.196296    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b8e5b1e-00f5-427e-af25-01eda802ac59-kube-api-access-569h7" (OuterVolumeSpecName: "kube-api-access-569h7") pod "2b8e5b1e-00f5-427e-af25-01eda802ac59" (UID: "2b8e5b1e-00f5-427e-af25-01eda802ac59"). InnerVolumeSpecName "kube-api-access-569h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:08:09.196330 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.196299    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b8e5b1e-00f5-427e-af25-01eda802ac59" (UID: "2b8e5b1e-00f5-427e-af25-01eda802ac59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:08:09.294604 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.294565    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-569h7\" (UniqueName: \"kubernetes.io/projected/2b8e5b1e-00f5-427e-af25-01eda802ac59-kube-api-access-569h7\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:09.294604 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.294600    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b8e5b1e-00f5-427e-af25-01eda802ac59-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:09.294604 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.294610    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b8e5b1e-00f5-427e-af25-01eda802ac59-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:09.436454 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.436417    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"]
Jul 20 14:08:09.438611 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:09.438589    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4b70e6d-f5658d958-kmcp6"]
Jul 20 14:08:11.193235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:11.193197    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b8e5b1e-00f5-427e-af25-01eda802ac59" path="/var/lib/kubelet/pods/2b8e5b1e-00f5-427e-af25-01eda802ac59/volumes"
Jul 20 14:08:13.284696 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:13.284659    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"]
Jul 20 14:08:13.288731 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:13.288700    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4b70e6d-lznxb"]
Jul 20 14:08:14.548868 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:14.548819    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"]
Jul 20 14:08:14.549351 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:14.549115    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy" containerID="cri-o://177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a" gracePeriod=30
Jul 20 14:08:15.192972 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.192937    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8ab064-c932-432c-a994-6397691f0b17" path="/var/lib/kubelet/pods/eb8ab064-c932-432c-a994-6397691f0b17/volumes"
Jul 20 14:08:15.430435 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430402    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"]
Jul 20 14:08:15.430794 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430781    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8e5b1e-00f5-427e-af25-01eda802ac59" containerName="maas-api"
Jul 20 14:08:15.430842 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430795    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8e5b1e-00f5-427e-af25-01eda802ac59" containerName="maas-api"
Jul 20 14:08:15.430842 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430817    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8ab064-c932-432c-a994-6397691f0b17" containerName="revoke-keys"
Jul 20 14:08:15.430842 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430822    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8ab064-c932-432c-a994-6397691f0b17" containerName="revoke-keys"
Jul 20 14:08:15.430955 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430896    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b8e5b1e-00f5-427e-af25-01eda802ac59" containerName="maas-api"
Jul 20 14:08:15.430955 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.430908    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8ab064-c932-432c-a994-6397691f0b17" containerName="revoke-keys"
Jul 20 14:08:15.432972 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.432955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.435489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.435470    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7b9d9097-openshift-default-dockercfg-t5xwg\""
Jul 20 14:08:15.447253 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.447141    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"]
Jul 20 14:08:15.551864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.551818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-data\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.551864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.551865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-socket\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.551901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57xjq\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-kube-api-access-57xjq\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.551939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istiod-ca-cert\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.551967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-certs\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.552014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-podinfo\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.552089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-credential-socket\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.552123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-token\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.552347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.552144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-envoy\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.652998 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.652955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57xjq\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-kube-api-access-57xjq\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653247 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653010    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istiod-ca-cert\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653247 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-certs\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653381 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-podinfo\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653381 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-credential-socket\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653381 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-token\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653541 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-envoy\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653541 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-data\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653541 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-socket\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653691 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653652    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-certs\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653753 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istiod-ca-cert\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653849 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-credential-socket\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.653963 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-socket\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.654044 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.653989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-data\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.655947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.655913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-envoy\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.656110 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.656091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-podinfo\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.661334 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.661298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-token\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.661586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.661567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57xjq\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-kube-api-access-57xjq\") pod \"e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") " pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.742919 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.742810    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:15.894714 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.894645    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"]
Jul 20 14:08:15.897818 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:08:15.897785    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c5d215_f4e8_41cf_8126_18ad31eaf37e.slice/crio-bc24952a31f3c4c6d27369742db631189328e0a53eda0dbd586c3f25c8c35cf5 WatchSource:0}: Error finding container bc24952a31f3c4c6d27369742db631189328e0a53eda0dbd586c3f25c8c35cf5: Status 404 returned error can't find the container with id bc24952a31f3c4c6d27369742db631189328e0a53eda0dbd586c3f25c8c35cf5
Jul 20 14:08:15.900062 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.900030    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:08:15.900189 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.900098    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:08:15.900189 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:15.900128    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:08:16.154390 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.154351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" event={"ID":"b2c5d215-f4e8-41cf-8126-18ad31eaf37e","Type":"ContainerStarted","Data":"95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"}
Jul 20 14:08:16.154561 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.154416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" event={"ID":"b2c5d215-f4e8-41cf-8126-18ad31eaf37e","Type":"ContainerStarted","Data":"bc24952a31f3c4c6d27369742db631189328e0a53eda0dbd586c3f25c8c35cf5"}
Jul 20 14:08:16.186357 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.186300    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podStartSLOduration=1.186282493 podStartE2EDuration="1.186282493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:08:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:08:16.17460692 +0000 UTC m=+1801.449851450" watchObservedRunningTime="2026-07-20 14:08:16.186282493 +0000 UTC m=+1801.461527019"
Jul 20 14:08:16.506245 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.506129    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:08:16.512682 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.512653    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:08:16.743148 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.743114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:16.748038 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:16.748009    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:17.160775 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.160738    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:17.161749 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.161728    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:17.657703 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.657671    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"]
Jul 20 14:08:17.660763 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.660737    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.663254 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.663235    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-7b9d9097-serving-cert\""
Jul 20 14:08:17.683641 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.682835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"]
Jul 20 14:08:17.771261 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.771220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5f817e-c0d4-4138-8c63-4b046a4903e0-openshift-service-ca\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.771641 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.771269    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.771641 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.771394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx8c8\" (UniqueName: \"kubernetes.io/projected/db5f817e-c0d4-4138-8c63-4b046a4903e0-kube-api-access-lx8c8\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.872588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.872544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx8c8\" (UniqueName: \"kubernetes.io/projected/db5f817e-c0d4-4138-8c63-4b046a4903e0-kube-api-access-lx8c8\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.872775 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.872628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5f817e-c0d4-4138-8c63-4b046a4903e0-openshift-service-ca\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.872775 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.872660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.872857 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:08:17.872796    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-serving-cert: secret "maas-api-e2e-derive-7b9d9097-serving-cert" not found
Jul 20 14:08:17.872892 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:08:17.872865    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls podName:db5f817e-c0d4-4138-8c63-4b046a4903e0 nodeName:}" failed. No retries permitted until 2026-07-20 14:08:18.372843753 +0000 UTC m=+1803.648088259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls") pod "maas-api-e2e-derive-7b9d9097-866b694567-7s627" (UID: "db5f817e-c0d4-4138-8c63-4b046a4903e0") : secret "maas-api-e2e-derive-7b9d9097-serving-cert" not found
Jul 20 14:08:17.873423 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.873401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5f817e-c0d4-4138-8c63-4b046a4903e0-openshift-service-ca\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:17.882601 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:17.882578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx8c8\" (UniqueName: \"kubernetes.io/projected/db5f817e-c0d4-4138-8c63-4b046a4903e0-kube-api-access-lx8c8\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:18.377787 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:18.377743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:18.380377 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:18.380353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls\") pod \"maas-api-e2e-derive-7b9d9097-866b694567-7s627\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:18.576377 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:18.576338    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:18.728879 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:18.728847    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"]
Jul 20 14:08:18.730675 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:08:18.730639    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5f817e_c0d4_4138_8c63_4b046a4903e0.slice/crio-f0144adf73c19b1edf3ecde65f51e15d4a551952508350e7f0f1237c3b49c5d1 WatchSource:0}: Error finding container f0144adf73c19b1edf3ecde65f51e15d4a551952508350e7f0f1237c3b49c5d1: Status 404 returned error can't find the container with id f0144adf73c19b1edf3ecde65f51e15d4a551952508350e7f0f1237c3b49c5d1
Jul 20 14:08:19.172224 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.172190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627" event={"ID":"db5f817e-c0d4-4138-8c63-4b046a4903e0","Type":"ContainerStarted","Data":"f0144adf73c19b1edf3ecde65f51e15d4a551952508350e7f0f1237c3b49c5d1"}
Jul 20 14:08:19.813231 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.813123    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:08:19.890241 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5132e68-2506-4aec-963f-664861178a94-istio-podinfo\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890241 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890248    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-istio-token\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890317    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-data\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890344    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-certs\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-credential-socket\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890414    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-socket\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-envoy\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890730 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5132e68-2506-4aec-963f-664861178a94-istiod-ca-cert\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890730 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890548    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9kh5\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-kube-api-access-s9kh5\") pod \"e5132e68-2506-4aec-963f-664861178a94\" (UID: \"e5132e68-2506-4aec-963f-664861178a94\") "
Jul 20 14:08:19.890858 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890829    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:08:19.891035 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890971    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:08:19.891227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.890783    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:08:19.891518 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.891471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5132e68-2506-4aec-963f-664861178a94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:08:19.891649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.891611    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:08:19.892819 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.892797    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5132e68-2506-4aec-963f-664861178a94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:08:19.893467 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.893438    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:08:19.893467 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.893451    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-kube-api-access-s9kh5" (OuterVolumeSpecName: "kube-api-access-s9kh5") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "kube-api-access-s9kh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:08:19.893928 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.893910    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5132e68-2506-4aec-963f-664861178a94" (UID: "e5132e68-2506-4aec-963f-664861178a94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:08:19.991958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.991921    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9kh5\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-kube-api-access-s9kh5\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.991958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.991958    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5132e68-2506-4aec-963f-664861178a94-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.991968    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5132e68-2506-4aec-963f-664861178a94-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.991978    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.991986    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.991994    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.992002    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.992010    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5132e68-2506-4aec-963f-664861178a94-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:19.992190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:19.992019    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5132e68-2506-4aec-963f-664861178a94-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:20.179226 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.179152    2559 generic.go:356] "Generic (PLEG): container finished" podID="e5132e68-2506-4aec-963f-664861178a94" containerID="177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a" exitCode=0
Jul 20 14:08:20.179226 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.179230    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"
Jul 20 14:08:20.179776 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.179253    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" event={"ID":"e5132e68-2506-4aec-963f-664861178a94","Type":"ContainerDied","Data":"177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a"}
Jul 20 14:08:20.179776 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.179350    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs" event={"ID":"e5132e68-2506-4aec-963f-664861178a94","Type":"ContainerDied","Data":"0e82e60aa723be706ad2fe7cad70cea2a7ab495266074b24eb4f37ac2c9e96b8"}
Jul 20 14:08:20.179776 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.179388    2559 scope.go:117] "RemoveContainer" containerID="177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a"
Jul 20 14:08:20.180802 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.180775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627" event={"ID":"db5f817e-c0d4-4138-8c63-4b046a4903e0","Type":"ContainerStarted","Data":"812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1"}
Jul 20 14:08:20.180935 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.180893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:20.191358 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.191331    2559 scope.go:117] "RemoveContainer" containerID="2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"
Jul 20 14:08:20.200598 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.200580    2559 scope.go:117] "RemoveContainer" containerID="177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a"
Jul 20 14:08:20.200879 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:08:20.200858    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a\": container with ID starting with 177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a not found: ID does not exist" containerID="177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a"
Jul 20 14:08:20.200931 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.200890    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a"} err="failed to get container status \"177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a\": rpc error: code = NotFound desc = could not find container \"177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a\": container with ID starting with 177aa967c755587cfe44f16bf879517beb3cf1ab7b8018f3aacfe12c513d148a not found: ID does not exist"
Jul 20 14:08:20.200931 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.200908    2559 scope.go:117] "RemoveContainer" containerID="2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"
Jul 20 14:08:20.201139 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:08:20.201122    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813\": container with ID starting with 2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813 not found: ID does not exist" containerID="2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"
Jul 20 14:08:20.201307 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.201149    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813"} err="failed to get container status \"2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813\": rpc error: code = NotFound desc = could not find container \"2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813\": container with ID starting with 2e995b865a283374790f7c2c0ff495fd7201365e7dde2b0f75cae8a24fe98813 not found: ID does not exist"
Jul 20 14:08:20.218752 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.218707    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627" podStartSLOduration=2.628576445 podStartE2EDuration="3.218692022s" totalImagesPullingTime="590.115577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:08:20.216273117 +0000 UTC m=+1805.491517646" watchObservedRunningTime="2026-07-20 14:08:20.218692022 +0000 UTC m=+1805.493936553"
Jul 20 14:08:20.250465 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.250429    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"]
Jul 20 14:08:20.253179 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:20.253138    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a4b70e6d-openshift-default-576fbb58b9-5d7gs"]
Jul 20 14:08:21.192991 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:21.192956    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5132e68-2506-4aec-963f-664861178a94" path="/var/lib/kubelet/pods/e5132e68-2506-4aec-963f-664861178a94/volumes"
Jul 20 14:08:26.197218 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:26.197146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:32.162338 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.162300    2559 patch_prober.go:28] interesting pod/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 20 14:08:32.162759 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.162357    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 20 14:08:32.255042 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.255006    2559 generic.go:356] "Generic (PLEG): container finished" podID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerID="95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558" exitCode=0
Jul 20 14:08:32.255244 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.255072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" event={"ID":"b2c5d215-f4e8-41cf-8126-18ad31eaf37e","Type":"ContainerDied","Data":"95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"}
Jul 20 14:08:32.255499 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.255484    2559 scope.go:117] "RemoveContainer" containerID="95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"
Jul 20 14:08:32.256547 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.256514    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:08:32.256657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.256600    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:08:32.256657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:32.256647    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:08:33.261563 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:33.261530    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" event={"ID":"b2c5d215-f4e8-41cf-8126-18ad31eaf37e","Type":"ContainerStarted","Data":"8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d"}
Jul 20 14:08:33.743238 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:33.743195    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:33.743454 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:33.743431    2559 patch_prober.go:28] interesting pod/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 20 14:08:33.743504 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:33.743481    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 20 14:08:34.743434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:34.743393    2559 patch_prober.go:28] interesting pod/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 20 14:08:34.743844 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:34.743450    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 20 14:08:35.743383 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:35.743343    2559 patch_prober.go:28] interesting pod/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 20 14:08:35.743574 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:35.743402    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 20 14:08:36.743752 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:36.743713    2559 patch_prober.go:28] interesting pod/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 20 14:08:36.744190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:36.743781    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 20 14:08:37.747693 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:37.747661    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:37.748124 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:37.747919    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:37.748701 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:37.748683    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:08:42.546422 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.546385    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"]
Jul 20 14:08:42.546853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.546787    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy"
Jul 20 14:08:42.546853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.546797    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy"
Jul 20 14:08:42.546853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.546814    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy"
Jul 20 14:08:42.546853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.546820    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy"
Jul 20 14:08:42.546993 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.546879    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy"
Jul 20 14:08:42.549000 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.548984    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:42.551822 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.551800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:08:42.563190 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.563137    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"]
Jul 20 14:08:42.609266 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.609230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw\" (UID: \"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:42.710232 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.710152    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw\" (UID: \"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:42.710771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.710751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw\" (UID: \"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:42.859546 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:42.859458    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:43.000824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:43.000792    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"]
Jul 20 14:08:43.005380 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:08:43.005353    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe23f78e_186a_402e_9fa7_c0e2bfc1dbd4.slice/crio-d68af580b47c73353ea1d3f4ca9c7169bd005a64c8fbfbed837a028d04441e6b WatchSource:0}: Error finding container d68af580b47c73353ea1d3f4ca9c7169bd005a64c8fbfbed837a028d04441e6b: Status 404 returned error can't find the container with id d68af580b47c73353ea1d3f4ca9c7169bd005a64c8fbfbed837a028d04441e6b
Jul 20 14:08:43.317712 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:43.317674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw" event={"ID":"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4","Type":"ContainerStarted","Data":"cf99308146ecd51856fe2bf82af7ca595265a876debbe95cab4af33dd4a48b90"}
Jul 20 14:08:43.317864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:43.317731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw" event={"ID":"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4","Type":"ContainerStarted","Data":"d68af580b47c73353ea1d3f4ca9c7169bd005a64c8fbfbed837a028d04441e6b"}
Jul 20 14:08:43.338333 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:43.338280    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw" podStartSLOduration=1.338263528 podStartE2EDuration="1.338263528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:08:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:08:43.335859727 +0000 UTC m=+1828.611104255" watchObservedRunningTime="2026-07-20 14:08:43.338263528 +0000 UTC m=+1828.613508058"
Jul 20 14:08:44.324375 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:44.324341    2559 generic.go:356] "Generic (PLEG): container finished" podID="be23f78e-186a-402e-9fa7-c0e2bfc1dbd4" containerID="cf99308146ecd51856fe2bf82af7ca595265a876debbe95cab4af33dd4a48b90" exitCode=0
Jul 20 14:08:44.324792 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:44.324437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw" event={"ID":"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4","Type":"ContainerDied","Data":"cf99308146ecd51856fe2bf82af7ca595265a876debbe95cab4af33dd4a48b90"}
Jul 20 14:08:45.469226 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:45.469201    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:45.537421 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:45.537386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4-maas-api-service-ca\") pod \"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4\" (UID: \"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4\") "
Jul 20 14:08:45.537752 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:45.537728    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be23f78e-186a-402e-9fa7-c0e2bfc1dbd4" (UID: "be23f78e-186a-402e-9fa7-c0e2bfc1dbd4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:08:45.638304 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:45.638217    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4-maas-api-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:46.336056 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:46.336029    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"
Jul 20 14:08:46.336056 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:46.336046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw" event={"ID":"be23f78e-186a-402e-9fa7-c0e2bfc1dbd4","Type":"ContainerDied","Data":"d68af580b47c73353ea1d3f4ca9c7169bd005a64c8fbfbed837a028d04441e6b"}
Jul 20 14:08:46.336354 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:46.336092    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d68af580b47c73353ea1d3f4ca9c7169bd005a64c8fbfbed837a028d04441e6b"
Jul 20 14:08:53.048829 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.048788    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"]
Jul 20 14:08:53.049366 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.049057    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627" podUID="db5f817e-c0d4-4138-8c63-4b046a4903e0" containerName="maas-api" containerID="cri-o://812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1" gracePeriod=30
Jul 20 14:08:53.301668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.301572    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:53.373193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.373123    2559 generic.go:356] "Generic (PLEG): container finished" podID="db5f817e-c0d4-4138-8c63-4b046a4903e0" containerID="812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1" exitCode=0
Jul 20 14:08:53.373374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.373222    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"
Jul 20 14:08:53.373374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.373219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627" event={"ID":"db5f817e-c0d4-4138-8c63-4b046a4903e0","Type":"ContainerDied","Data":"812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1"}
Jul 20 14:08:53.373374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.373338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627" event={"ID":"db5f817e-c0d4-4138-8c63-4b046a4903e0","Type":"ContainerDied","Data":"f0144adf73c19b1edf3ecde65f51e15d4a551952508350e7f0f1237c3b49c5d1"}
Jul 20 14:08:53.373374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.373361    2559 scope.go:117] "RemoveContainer" containerID="812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1"
Jul 20 14:08:53.382242 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.382221    2559 scope.go:117] "RemoveContainer" containerID="812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1"
Jul 20 14:08:53.382550 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:08:53.382533    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1\": container with ID starting with 812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1 not found: ID does not exist" containerID="812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1"
Jul 20 14:08:53.382600 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.382562    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1"} err="failed to get container status \"812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1\": rpc error: code = NotFound desc = could not find container \"812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1\": container with ID starting with 812cbc37102c7a79cc19a3f91b49735f5299d6d6dcfb52873d9d964aa674bba1 not found: ID does not exist"
Jul 20 14:08:53.408947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.408912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls\") pod \"db5f817e-c0d4-4138-8c63-4b046a4903e0\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") "
Jul 20 14:08:53.409146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.408957    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx8c8\" (UniqueName: \"kubernetes.io/projected/db5f817e-c0d4-4138-8c63-4b046a4903e0-kube-api-access-lx8c8\") pod \"db5f817e-c0d4-4138-8c63-4b046a4903e0\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") "
Jul 20 14:08:53.409146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.408991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5f817e-c0d4-4138-8c63-4b046a4903e0-openshift-service-ca\") pod \"db5f817e-c0d4-4138-8c63-4b046a4903e0\" (UID: \"db5f817e-c0d4-4138-8c63-4b046a4903e0\") "
Jul 20 14:08:53.409484 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.409448    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db5f817e-c0d4-4138-8c63-4b046a4903e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db5f817e-c0d4-4138-8c63-4b046a4903e0" (UID: "db5f817e-c0d4-4138-8c63-4b046a4903e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:08:53.411416 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.411392    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5f817e-c0d4-4138-8c63-4b046a4903e0-kube-api-access-lx8c8" (OuterVolumeSpecName: "kube-api-access-lx8c8") pod "db5f817e-c0d4-4138-8c63-4b046a4903e0" (UID: "db5f817e-c0d4-4138-8c63-4b046a4903e0"). InnerVolumeSpecName "kube-api-access-lx8c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:08:53.411534 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.411510    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db5f817e-c0d4-4138-8c63-4b046a4903e0" (UID: "db5f817e-c0d4-4138-8c63-4b046a4903e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:08:53.510323 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.510280    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db5f817e-c0d4-4138-8c63-4b046a4903e0-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:53.510323 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.510315    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx8c8\" (UniqueName: \"kubernetes.io/projected/db5f817e-c0d4-4138-8c63-4b046a4903e0-kube-api-access-lx8c8\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:53.510323 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.510330    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db5f817e-c0d4-4138-8c63-4b046a4903e0-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:08:53.695584 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.695545    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"]
Jul 20 14:08:53.702246 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:53.702206    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7b9d9097-866b694567-7s627"]
Jul 20 14:08:55.194777 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:55.194731    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db5f817e-c0d4-4138-8c63-4b046a4903e0" path="/var/lib/kubelet/pods/db5f817e-c0d4-4138-8c63-4b046a4903e0/volumes"
Jul 20 14:08:57.691790 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:57.691751    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"]
Jul 20 14:08:57.694572 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:57.694542    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7b9d9097-sgfvw"]
Jul 20 14:08:57.852446 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:57.852407    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"]
Jul 20 14:08:57.852707 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:57.852677    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy" containerID="cri-o://8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d" gracePeriod=30
Jul 20 14:08:59.193248 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:08:59.193207    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be23f78e-186a-402e-9fa7-c0e2bfc1dbd4" path="/var/lib/kubelet/pods/be23f78e-186a-402e-9fa7-c0e2bfc1dbd4/volumes"
Jul 20 14:09:03.122240 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.122144    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:09:03.303422 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istiod-ca-cert\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303422 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-certs\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-envoy\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303477    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-socket\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303532    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-token\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303595    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-data\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-credential-socket\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57xjq\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-kube-api-access-57xjq\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.303695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303675    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-podinfo\") pod \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\" (UID: \"b2c5d215-f4e8-41cf-8126-18ad31eaf37e\") "
Jul 20 14:09:03.304031 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:09:03.304031 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:09:03.304031 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.303997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:09:03.304232 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.304063    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.304232 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.304080    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.304727 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.304670    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:09:03.304727 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.304587    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:09:03.306191 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.306138    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:09:03.306327 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.306238    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-kube-api-access-57xjq" (OuterVolumeSpecName: "kube-api-access-57xjq") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "kube-api-access-57xjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:09:03.306518 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.306497    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:09:03.306753 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.306731    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2c5d215-f4e8-41cf-8126-18ad31eaf37e" (UID: "b2c5d215-f4e8-41cf-8126-18ad31eaf37e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:09:03.405298 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405255    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.405298 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405288    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.405298 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405299    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.405298 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405308    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57xjq\" (UniqueName: \"kubernetes.io/projected/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-kube-api-access-57xjq\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.405694 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405316    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.405694 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405326    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.405694 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.405334    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c5d215-f4e8-41cf-8126-18ad31eaf37e-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:09:03.429098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.429062    2559 generic.go:356] "Generic (PLEG): container finished" podID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerID="8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d" exitCode=0
Jul 20 14:09:03.429300 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.429111    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"
Jul 20 14:09:03.429300 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.429126    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" event={"ID":"b2c5d215-f4e8-41cf-8126-18ad31eaf37e","Type":"ContainerDied","Data":"8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d"}
Jul 20 14:09:03.429300 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.429213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff" event={"ID":"b2c5d215-f4e8-41cf-8126-18ad31eaf37e","Type":"ContainerDied","Data":"bc24952a31f3c4c6d27369742db631189328e0a53eda0dbd586c3f25c8c35cf5"}
Jul 20 14:09:03.429300 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.429243    2559 scope.go:117] "RemoveContainer" containerID="8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d"
Jul 20 14:09:03.440944 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.440919    2559 scope.go:117] "RemoveContainer" containerID="95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"
Jul 20 14:09:03.450490 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.450439    2559 scope.go:117] "RemoveContainer" containerID="8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d"
Jul 20 14:09:03.450847 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:09:03.450816    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d\": container with ID starting with 8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d not found: ID does not exist" containerID="8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d"
Jul 20 14:09:03.450964 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.450860    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d"} err="failed to get container status \"8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d\": rpc error: code = NotFound desc = could not find container \"8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d\": container with ID starting with 8fe9acabcd884465a78b96aaa7d8b943679374717d45bce0645f10c72401ef0d not found: ID does not exist"
Jul 20 14:09:03.450964 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.450882    2559 scope.go:117] "RemoveContainer" containerID="95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"
Jul 20 14:09:03.451194 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:09:03.451173    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558\": container with ID starting with 95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558 not found: ID does not exist" containerID="95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"
Jul 20 14:09:03.451276 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.451197    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558"} err="failed to get container status \"95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558\": rpc error: code = NotFound desc = could not find container \"95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558\": container with ID starting with 95fdbff3863b8304c8ac5cc0f150eb7c988991f72f463ee0ca94a131b8f2a558 not found: ID does not exist"
Jul 20 14:09:03.452987 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.452967    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"]
Jul 20 14:09:03.461849 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:03.461819    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7b9d9097-openshift-default-5f4f6dbcb7-7c9ff"]
Jul 20 14:09:05.195087 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:09:05.195044    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" path="/var/lib/kubelet/pods/b2c5d215-f4e8-41cf-8126-18ad31eaf37e/volumes"
Jul 20 14:10:40.430485 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430442    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"]
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430831    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be23f78e-186a-402e-9fa7-c0e2bfc1dbd4" containerName="revoke-keys"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430842    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be23f78e-186a-402e-9fa7-c0e2bfc1dbd4" containerName="revoke-keys"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430849    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430854    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430860    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430865    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430880    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5f817e-c0d4-4138-8c63-4b046a4903e0" containerName="maas-api"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430885    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5f817e-c0d4-4138-8c63-4b046a4903e0" containerName="maas-api"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430939    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430948    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="db5f817e-c0d4-4138-8c63-4b046a4903e0" containerName="maas-api"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430954    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="be23f78e-186a-402e-9fa7-c0e2bfc1dbd4" containerName="revoke-keys"
Jul 20 14:10:40.431210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.430962    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5132e68-2506-4aec-963f-664861178a94" containerName="istio-proxy"
Jul 20 14:10:40.434006 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.433989    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.436486 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.436465    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2eba477f-openshift-default-dockercfg-7wkmc\""
Jul 20 14:10:40.463638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.463599    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"]
Jul 20 14:10:40.506252 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73603fa2-ea3c-49de-8de5-2974962f33a1-istiod-ca-cert\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506425 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-socket\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506425 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-token\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506425 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-envoy\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506530 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-credential-socket\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506530 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-podinfo\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506530 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74xjb\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-kube-api-access-74xjb\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506530 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-certs\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.506693 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.506566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-data\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.607857 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-envoy\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-credential-socket\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-podinfo\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xjb\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-kube-api-access-74xjb\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-certs\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-data\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.607987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73603fa2-ea3c-49de-8de5-2974962f33a1-istiod-ca-cert\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-socket\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608045    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-token\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608514 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-credential-socket\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608514 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-socket\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-data\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608734 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73603fa2-ea3c-49de-8de5-2974962f33a1-istiod-ca-cert\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.608786 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.608722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-certs\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.611021 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.610993    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-envoy\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.611188 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.611145    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-podinfo\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.619291 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.619267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74xjb\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-kube-api-access-74xjb\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.619516 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.619492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-token\") pod \"e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") " pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.744693 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.744598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:40.895391 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.895272    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"]
Jul 20 14:10:40.898315 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:10:40.898280    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73603fa2_ea3c_49de_8de5_2974962f33a1.slice/crio-92e471f4a884eef510d2bd647e4a8a107ee5181fa2bc411448c9d6443da1d3ab WatchSource:0}: Error finding container 92e471f4a884eef510d2bd647e4a8a107ee5181fa2bc411448c9d6443da1d3ab: Status 404 returned error can't find the container with id 92e471f4a884eef510d2bd647e4a8a107ee5181fa2bc411448c9d6443da1d3ab
Jul 20 14:10:40.900590 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.900555    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:10:40.900657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.900622    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:10:40.900657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.900649    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:10:40.940534 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:40.940505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" event={"ID":"73603fa2-ea3c-49de-8de5-2974962f33a1","Type":"ContainerStarted","Data":"92e471f4a884eef510d2bd647e4a8a107ee5181fa2bc411448c9d6443da1d3ab"}
Jul 20 14:10:41.946559 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:41.946517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" event={"ID":"73603fa2-ea3c-49de-8de5-2974962f33a1","Type":"ContainerStarted","Data":"86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"}
Jul 20 14:10:41.966543 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:41.966487    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podStartSLOduration=1.9664710300000001 podStartE2EDuration="1.96647103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:10:41.96518402 +0000 UTC m=+1947.240428540" watchObservedRunningTime="2026-07-20 14:10:41.96647103 +0000 UTC m=+1947.241715558"
Jul 20 14:10:42.745813 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:42.745781    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:42.750625 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:42.750597    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:42.952303 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:42.952279    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:42.953386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:42.953366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:10:44.052014 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.051980    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"]
Jul 20 14:10:44.052624 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.052603    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c5d215-f4e8-41cf-8126-18ad31eaf37e" containerName="istio-proxy"
Jul 20 14:10:44.055865 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.055841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.058194 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.058153    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2eba477f-serving-cert\""
Jul 20 14:10:44.068375 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.068353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"]
Jul 20 14:10:44.142287 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.142249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96d37136-9f40-4dee-a72b-031abd48ca07-maas-api-tls\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.142475 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.142316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnpcn\" (UniqueName: \"kubernetes.io/projected/96d37136-9f40-4dee-a72b-031abd48ca07-kube-api-access-cnpcn\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.142475 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.142389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d37136-9f40-4dee-a72b-031abd48ca07-openshift-service-ca\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.243227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.243189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d37136-9f40-4dee-a72b-031abd48ca07-openshift-service-ca\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.243387 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.243348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96d37136-9f40-4dee-a72b-031abd48ca07-maas-api-tls\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.243624 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.243584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnpcn\" (UniqueName: \"kubernetes.io/projected/96d37136-9f40-4dee-a72b-031abd48ca07-kube-api-access-cnpcn\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.243956 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.243928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d37136-9f40-4dee-a72b-031abd48ca07-openshift-service-ca\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.245948 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.245925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96d37136-9f40-4dee-a72b-031abd48ca07-maas-api-tls\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.258217 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.258196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnpcn\" (UniqueName: \"kubernetes.io/projected/96d37136-9f40-4dee-a72b-031abd48ca07-kube-api-access-cnpcn\") pod \"maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.367253 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.367137    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:44.509199 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.509148    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"]
Jul 20 14:10:44.511333 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:10:44.511298    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d37136_9f40_4dee_a72b_031abd48ca07.slice/crio-d6c8a25b1ce59f4627386704469d3f9a855e864c3bdee569827219b9142c1855 WatchSource:0}: Error finding container d6c8a25b1ce59f4627386704469d3f9a855e864c3bdee569827219b9142c1855: Status 404 returned error can't find the container with id d6c8a25b1ce59f4627386704469d3f9a855e864c3bdee569827219b9142c1855
Jul 20 14:10:44.963216 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:44.963180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh" event={"ID":"96d37136-9f40-4dee-a72b-031abd48ca07","Type":"ContainerStarted","Data":"d6c8a25b1ce59f4627386704469d3f9a855e864c3bdee569827219b9142c1855"}
Jul 20 14:10:45.969748 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:45.969709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh" event={"ID":"96d37136-9f40-4dee-a72b-031abd48ca07","Type":"ContainerStarted","Data":"17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158"}
Jul 20 14:10:45.970283 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:45.969780    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:45.985954 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:45.985900    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh" podStartSLOduration=1.474675628 podStartE2EDuration="1.985883636s" totalImagesPullingTime="511.208008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:10:45.985075874 +0000 UTC m=+1951.260320402" watchObservedRunningTime="2026-07-20 14:10:45.985883636 +0000 UTC m=+1951.261128164"
Jul 20 14:10:51.980463 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:51.980430    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:10:55.699503 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.699454    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"]
Jul 20 14:10:55.705124 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.705091    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:10:55.710954 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.710538    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"]
Jul 20 14:10:55.714108 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.714062    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f6xfk\""
Jul 20 14:10:55.852130 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.852091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk\" (UID: \"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:10:55.953344 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.953249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk\" (UID: \"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:10:55.953960 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:55.953933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk\" (UID: \"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:10:56.028210 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:56.028179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:10:56.210050 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:56.209892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"]
Jul 20 14:10:57.033612 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:57.033574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk" event={"ID":"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b","Type":"ContainerStarted","Data":"59e44cc77bf49b7d21c62788280b3b20fe448020fc190fa6edaab9050f4f0648"}
Jul 20 14:10:57.034007 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:57.033637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk" event={"ID":"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b","Type":"ContainerStarted","Data":"91c3209c47dda726f19233843a18d9b872396f39b818773cc984585b4ccdbf19"}
Jul 20 14:10:57.048408 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:57.048365    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk" podStartSLOduration=2.048348405 podStartE2EDuration="2.048348405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:10:57.047587301 +0000 UTC m=+1962.322831829" watchObservedRunningTime="2026-07-20 14:10:57.048348405 +0000 UTC m=+1962.323592934"
Jul 20 14:10:58.041235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:58.041189    2559 generic.go:356] "Generic (PLEG): container finished" podID="3f4a1f94-e8fa-4feb-9184-5d9c0f43373b" containerID="59e44cc77bf49b7d21c62788280b3b20fe448020fc190fa6edaab9050f4f0648" exitCode=0
Jul 20 14:10:58.041630 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:58.041230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk" event={"ID":"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b","Type":"ContainerDied","Data":"59e44cc77bf49b7d21c62788280b3b20fe448020fc190fa6edaab9050f4f0648"}
Jul 20 14:10:58.994374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:58.994312    2559 patch_prober.go:28] interesting pod/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 14:10:58.994634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:58.994396    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 14:10:59.184554 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:59.184522    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:10:59.291399 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:59.291298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b-maas-api-service-ca\") pod \"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b\" (UID: \"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b\") "
Jul 20 14:10:59.291765 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:59.291738    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3f4a1f94-e8fa-4feb-9184-5d9c0f43373b" (UID: "3f4a1f94-e8fa-4feb-9184-5d9c0f43373b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:10:59.392290 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:10:59.392257    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b-maas-api-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:00.053653 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.053620    2559 generic.go:356] "Generic (PLEG): container finished" podID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerID="86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae" exitCode=0
Jul 20 14:11:00.053873 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.053699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" event={"ID":"73603fa2-ea3c-49de-8de5-2974962f33a1","Type":"ContainerDied","Data":"86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"}
Jul 20 14:11:00.054145 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.054126    2559 scope.go:117] "RemoveContainer" containerID="86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"
Jul 20 14:11:00.055045 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.055021    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk" event={"ID":"3f4a1f94-e8fa-4feb-9184-5d9c0f43373b","Type":"ContainerDied","Data":"91c3209c47dda726f19233843a18d9b872396f39b818773cc984585b4ccdbf19"}
Jul 20 14:11:00.055150 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.055067    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91c3209c47dda726f19233843a18d9b872396f39b818773cc984585b4ccdbf19"
Jul 20 14:11:00.055150 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.055095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"
Jul 20 14:11:00.055260 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.055234    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:00.055316 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.055300    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:00.055362 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:00.055337    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:01.063567 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:01.063529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" event={"ID":"73603fa2-ea3c-49de-8de5-2974962f33a1","Type":"ContainerStarted","Data":"19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f"}
Jul 20 14:11:01.745046 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:01.745000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:11:01.745288 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:01.745247    2559 patch_prober.go:28] interesting pod/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 14:11:01.745345 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:01.745305    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 14:11:02.745360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:02.745322    2559 patch_prober.go:28] interesting pod/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 14:11:02.745783 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:02.745382    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 14:11:03.745240 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:03.745202    2559 patch_prober.go:28] interesting pod/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 14:11:03.745421 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:03.745261    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 14:11:04.745624 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:04.745585    2559 patch_prober.go:28] interesting pod/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 20 14:11:04.746034 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:04.745647    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 20 14:11:05.749388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:05.749362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:11:05.749876 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:05.749724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:11:05.750398 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:05.750381    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:11:06.324990 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.324953    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"]
Jul 20 14:11:06.325621 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.325577    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh" podUID="96d37136-9f40-4dee-a72b-031abd48ca07" containerName="maas-api" containerID="cri-o://17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158" gracePeriod=30
Jul 20 14:11:06.602205 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.602177    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:11:06.762235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.762184    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d37136-9f40-4dee-a72b-031abd48ca07-openshift-service-ca\") pod \"96d37136-9f40-4dee-a72b-031abd48ca07\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") "
Jul 20 14:11:06.762663 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.762270    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnpcn\" (UniqueName: \"kubernetes.io/projected/96d37136-9f40-4dee-a72b-031abd48ca07-kube-api-access-cnpcn\") pod \"96d37136-9f40-4dee-a72b-031abd48ca07\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") "
Jul 20 14:11:06.762663 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.762342    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96d37136-9f40-4dee-a72b-031abd48ca07-maas-api-tls\") pod \"96d37136-9f40-4dee-a72b-031abd48ca07\" (UID: \"96d37136-9f40-4dee-a72b-031abd48ca07\") "
Jul 20 14:11:06.762663 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.762603    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d37136-9f40-4dee-a72b-031abd48ca07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96d37136-9f40-4dee-a72b-031abd48ca07" (UID: "96d37136-9f40-4dee-a72b-031abd48ca07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:11:06.764571 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.764545    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d37136-9f40-4dee-a72b-031abd48ca07-kube-api-access-cnpcn" (OuterVolumeSpecName: "kube-api-access-cnpcn") pod "96d37136-9f40-4dee-a72b-031abd48ca07" (UID: "96d37136-9f40-4dee-a72b-031abd48ca07"). InnerVolumeSpecName "kube-api-access-cnpcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:11:06.764631 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.764566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d37136-9f40-4dee-a72b-031abd48ca07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96d37136-9f40-4dee-a72b-031abd48ca07" (UID: "96d37136-9f40-4dee-a72b-031abd48ca07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:11:06.863343 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.863242    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96d37136-9f40-4dee-a72b-031abd48ca07-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:06.863343 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.863280    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d37136-9f40-4dee-a72b-031abd48ca07-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:06.863343 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:06.863294    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnpcn\" (UniqueName: \"kubernetes.io/projected/96d37136-9f40-4dee-a72b-031abd48ca07-kube-api-access-cnpcn\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:07.097912 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.097876    2559 generic.go:356] "Generic (PLEG): container finished" podID="96d37136-9f40-4dee-a72b-031abd48ca07" containerID="17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158" exitCode=0
Jul 20 14:11:07.098085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.097937    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"
Jul 20 14:11:07.098085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.097961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh" event={"ID":"96d37136-9f40-4dee-a72b-031abd48ca07","Type":"ContainerDied","Data":"17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158"}
Jul 20 14:11:07.098085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.098016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh" event={"ID":"96d37136-9f40-4dee-a72b-031abd48ca07","Type":"ContainerDied","Data":"d6c8a25b1ce59f4627386704469d3f9a855e864c3bdee569827219b9142c1855"}
Jul 20 14:11:07.098085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.098038    2559 scope.go:117] "RemoveContainer" containerID="17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158"
Jul 20 14:11:07.107370 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.107348    2559 scope.go:117] "RemoveContainer" containerID="17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158"
Jul 20 14:11:07.107656 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:11:07.107636    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158\": container with ID starting with 17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158 not found: ID does not exist" containerID="17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158"
Jul 20 14:11:07.107712 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.107664    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158"} err="failed to get container status \"17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158\": rpc error: code = NotFound desc = could not find container \"17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158\": container with ID starting with 17760f5d47887cf8988324a860bda90f5d236593154e0da345ba74a9a418b158 not found: ID does not exist"
Jul 20 14:11:07.119730 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.119643    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"]
Jul 20 14:11:07.127829 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.127796    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2eba477f-675bb7ffb-76vhh"]
Jul 20 14:11:07.194595 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:07.194560    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d37136-9f40-4dee-a72b-031abd48ca07" path="/var/lib/kubelet/pods/96d37136-9f40-4dee-a72b-031abd48ca07/volumes"
Jul 20 14:11:10.772556 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:10.772521    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"]
Jul 20 14:11:10.775047 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:10.775017    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2eba477f-fj8rk"]
Jul 20 14:11:11.192244 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:11.192208    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f4a1f94-e8fa-4feb-9184-5d9c0f43373b" path="/var/lib/kubelet/pods/3f4a1f94-e8fa-4feb-9184-5d9c0f43373b/volumes"
Jul 20 14:11:17.510574 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:17.510534    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"]
Jul 20 14:11:17.511180 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:17.510760    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" containerID="cri-o://19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f" gracePeriod=30
Jul 20 14:11:20.751591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:20.751551    2559 patch_prober.go:28] interesting pod/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 20 14:11:20.752031 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:20.751629    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 14:11:22.769302 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.769278    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:11:22.803965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.803892    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-envoy\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.803965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.803936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-podinfo\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804211 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804050    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74xjb\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-kube-api-access-74xjb\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804211 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804083    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-certs\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804322 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804228    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-socket\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804322 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804308    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-credential-socket\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804425 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804356    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73603fa2-ea3c-49de-8de5-2974962f33a1-istiod-ca-cert\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804425 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804409    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:11:22.804544 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804446    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-data\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804544 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804477    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-token\") pod \"73603fa2-ea3c-49de-8de5-2974962f33a1\" (UID: \"73603fa2-ea3c-49de-8de5-2974962f33a1\") "
Jul 20 14:11:22.804802 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804738    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73603fa2-ea3c-49de-8de5-2974962f33a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:11:22.804802 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804769    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.805070 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.804944    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:11:22.805134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.805071    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:11:22.805431 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.805409    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:11:22.806560 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.806534    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-kube-api-access-74xjb" (OuterVolumeSpecName: "kube-api-access-74xjb") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "kube-api-access-74xjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:11:22.806731 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.806714    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:11:22.806816 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.806803    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:11:22.807246 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.807224    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "73603fa2-ea3c-49de-8de5-2974962f33a1" (UID: "73603fa2-ea3c-49de-8de5-2974962f33a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:11:22.906037 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906000    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906037 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906031    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906037 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906040    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906048    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74xjb\" (UniqueName: \"kubernetes.io/projected/73603fa2-ea3c-49de-8de5-2974962f33a1-kube-api-access-74xjb\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906057    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906068    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906076    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73603fa2-ea3c-49de-8de5-2974962f33a1-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:22.906321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:22.906097    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73603fa2-ea3c-49de-8de5-2974962f33a1-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:11:23.189269 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.189216    2559 generic.go:356] "Generic (PLEG): container finished" podID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerID="19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f" exitCode=0
Jul 20 14:11:23.189460 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.189313    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"
Jul 20 14:11:23.192618 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.192595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" event={"ID":"73603fa2-ea3c-49de-8de5-2974962f33a1","Type":"ContainerDied","Data":"19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f"}
Jul 20 14:11:23.192728 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.192642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2" event={"ID":"73603fa2-ea3c-49de-8de5-2974962f33a1","Type":"ContainerDied","Data":"92e471f4a884eef510d2bd647e4a8a107ee5181fa2bc411448c9d6443da1d3ab"}
Jul 20 14:11:23.192728 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.192663    2559 scope.go:117] "RemoveContainer" containerID="19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f"
Jul 20 14:11:23.204836 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.204547    2559 scope.go:117] "RemoveContainer" containerID="86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"
Jul 20 14:11:23.214928 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.214906    2559 scope.go:117] "RemoveContainer" containerID="19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f"
Jul 20 14:11:23.215270 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:11:23.215252    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f\": container with ID starting with 19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f not found: ID does not exist" containerID="19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f"
Jul 20 14:11:23.215354 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.215285    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f"} err="failed to get container status \"19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f\": rpc error: code = NotFound desc = could not find container \"19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f\": container with ID starting with 19b612969d4f6a95cf39e91f2542c260159264005dfd2173dd6504234f8a832f not found: ID does not exist"
Jul 20 14:11:23.215354 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.215310    2559 scope.go:117] "RemoveContainer" containerID="86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"
Jul 20 14:11:23.215598 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:11:23.215581    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae\": container with ID starting with 86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae not found: ID does not exist" containerID="86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"
Jul 20 14:11:23.215636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.215605    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae"} err="failed to get container status \"86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae\": rpc error: code = NotFound desc = could not find container \"86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae\": container with ID starting with 86d0d62fc992c22e86b30e6a20abba2aaabf20f9e518e9342bb75b210983f9ae not found: ID does not exist"
Jul 20 14:11:23.220381 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.220355    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"]
Jul 20 14:11:23.225672 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:23.225645    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2eba477f-openshift-default-6b94768c-5qdd2"]
Jul 20 14:11:25.194109 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:25.194073    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" path="/var/lib/kubelet/pods/73603fa2-ea3c-49de-8de5-2974962f33a1/volumes"
Jul 20 14:11:37.195763 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.195734    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"]
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196096    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4a1f94-e8fa-4feb-9184-5d9c0f43373b" containerName="revoke-keys"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196108    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4a1f94-e8fa-4feb-9184-5d9c0f43373b" containerName="revoke-keys"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196119    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196125    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196132    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196137    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196147    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d37136-9f40-4dee-a72b-031abd48ca07" containerName="maas-api"
Jul 20 14:11:37.196235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196152    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d37136-9f40-4dee-a72b-031abd48ca07" containerName="maas-api"
Jul 20 14:11:37.196636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196289    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy"
Jul 20 14:11:37.196636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196308    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d37136-9f40-4dee-a72b-031abd48ca07" containerName="maas-api"
Jul 20 14:11:37.196636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.196317    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4a1f94-e8fa-4feb-9184-5d9c0f43373b" containerName="revoke-keys"
Jul 20 14:11:37.199821 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.199794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.202890 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.202865    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-17600a65-openshift-default-dockercfg-tn8w2\""
Jul 20 14:11:37.210542 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.210518    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"]
Jul 20 14:11:37.340270 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-socket\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340270 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-token\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-data\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-podinfo\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-certs\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istiod-ca-cert\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5cwb\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-kube-api-access-j5cwb\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-credential-socket\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.340682 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.340503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-envoy\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441404 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5cwb\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-kube-api-access-j5cwb\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-credential-socket\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-envoy\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-socket\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-token\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-data\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441844 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-podinfo\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441844 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-certs\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441938 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istiod-ca-cert\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.441938 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441896    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-credential-socket\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.442033 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.441944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-socket\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.442088 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.442051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-data\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.442257 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.442233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-certs\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.442534 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.442517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istiod-ca-cert\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.444054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.444033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-envoy\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.444273 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.444257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-podinfo\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.450679 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.450620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-token\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.450786 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.450768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5cwb\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-kube-api-access-j5cwb\") pod \"e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") " pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.512692 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.512651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:37.659903 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.659870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"]
Jul 20 14:11:37.661834 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:11:37.661805    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f45e1b_192d_4cfb_bc20_7ca0b0951daf.slice/crio-a96dcf8da7a2cd3e74eaabb484537625a68e4cbdb33c740e313311853434caa7 WatchSource:0}: Error finding container a96dcf8da7a2cd3e74eaabb484537625a68e4cbdb33c740e313311853434caa7: Status 404 returned error can't find the container with id a96dcf8da7a2cd3e74eaabb484537625a68e4cbdb33c740e313311853434caa7
Jul 20 14:11:37.664150 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.664107    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:37.664254 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.664226    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:37.666206 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:37.664808    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:38.269091 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:38.269052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" event={"ID":"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf","Type":"ContainerStarted","Data":"1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"}
Jul 20 14:11:38.269517 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:38.269138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" event={"ID":"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf","Type":"ContainerStarted","Data":"a96dcf8da7a2cd3e74eaabb484537625a68e4cbdb33c740e313311853434caa7"}
Jul 20 14:11:38.292405 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:38.292328    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podStartSLOduration=1.292309234 podStartE2EDuration="1.292309234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:11:38.290860467 +0000 UTC m=+2003.566105003" watchObservedRunningTime="2026-07-20 14:11:38.292309234 +0000 UTC m=+2003.567553765"
Jul 20 14:11:38.513688 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:38.513644    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:38.515336 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:38.515307    2559 patch_prober.go:28] interesting pod/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 14:11:38.515480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:38.515362    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 14:11:39.517282 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:39.517248    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:40.279919 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.279884    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:40.280853 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.280828    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:40.394195 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.394144    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"]
Jul 20 14:11:40.394603 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.394589    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="73603fa2-ea3c-49de-8de5-2974962f33a1" containerName="istio-proxy"
Jul 20 14:11:40.396953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.396933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.399524 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.399501    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-17600a65-serving-cert\""
Jul 20 14:11:40.417115 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.417080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"]
Jul 20 14:11:40.471438 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.471401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c73586-d3cc-46bc-9981-f275a70207d0-maas-api-tls\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.471636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.471461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c73586-d3cc-46bc-9981-f275a70207d0-openshift-service-ca\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.471636 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.471568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vth22\" (UniqueName: \"kubernetes.io/projected/a8c73586-d3cc-46bc-9981-f275a70207d0-kube-api-access-vth22\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.572744 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.572646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c73586-d3cc-46bc-9981-f275a70207d0-maas-api-tls\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.572744 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.572706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c73586-d3cc-46bc-9981-f275a70207d0-openshift-service-ca\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.573216 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.572816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vth22\" (UniqueName: \"kubernetes.io/projected/a8c73586-d3cc-46bc-9981-f275a70207d0-kube-api-access-vth22\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.573388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.573370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c73586-d3cc-46bc-9981-f275a70207d0-openshift-service-ca\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.575359 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.575336    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c73586-d3cc-46bc-9981-f275a70207d0-maas-api-tls\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.585250 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.585215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vth22\" (UniqueName: \"kubernetes.io/projected/a8c73586-d3cc-46bc-9981-f275a70207d0-kube-api-access-vth22\") pod \"maas-api-e2e-mt-17600a65-8b46b575b-5c4qw\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.708275 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.708234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:40.849032 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.849006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"]
Jul 20 14:11:40.851962 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:11:40.851933    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c73586_d3cc_46bc_9981_f275a70207d0.slice/crio-eb0bfb754cca2450b15d6fee5db324808af32910cdd48c3fe45fb3c3a560a574 WatchSource:0}: Error finding container eb0bfb754cca2450b15d6fee5db324808af32910cdd48c3fe45fb3c3a560a574: Status 404 returned error can't find the container with id eb0bfb754cca2450b15d6fee5db324808af32910cdd48c3fe45fb3c3a560a574
Jul 20 14:11:40.854196 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:40.854149    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 14:11:41.286061 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:41.286029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw" event={"ID":"a8c73586-d3cc-46bc-9981-f275a70207d0","Type":"ContainerStarted","Data":"eb0bfb754cca2450b15d6fee5db324808af32910cdd48c3fe45fb3c3a560a574"}
Jul 20 14:11:42.293893 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:42.293855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw" event={"ID":"a8c73586-d3cc-46bc-9981-f275a70207d0","Type":"ContainerStarted","Data":"8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6"}
Jul 20 14:11:42.294345 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:42.294289    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:42.312063 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:42.312008    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw" podStartSLOduration=1.924715419 podStartE2EDuration="2.311992225s" totalImagesPullingTime="387.276806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:11:42.310391052 +0000 UTC m=+2007.585635583" watchObservedRunningTime="2026-07-20 14:11:42.311992225 +0000 UTC m=+2007.587236754"
Jul 20 14:11:47.758303 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.758263    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"]
Jul 20 14:11:47.760802 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.760783    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:47.763326 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.763305    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-17600a65\"/\"openshift-service-ca.crt\""
Jul 20 14:11:47.764215 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.764177    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-17600a65\"/\"e2e-lifecycle-model-17600a65-kserve-self-signed-certs\""
Jul 20 14:11:47.764365 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.764180    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-17600a65\"/\"kube-root-ca.crt\""
Jul 20 14:11:47.764365 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.764192    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-17600a65\"/\"default-dockercfg-vdphj\""
Jul 20 14:11:47.770267 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.770239    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"]
Jul 20 14:11:47.956384 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.956338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-home\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:47.956591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.956419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tmp-dir\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:47.956591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.956456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-dshm\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:47.956591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.956517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-model-cache\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:47.956591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.956576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqn6\" (UniqueName: \"kubernetes.io/projected/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-kube-api-access-mkqn6\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:47.956779 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:47.956602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tls-certs\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057523 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-home\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057523 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tmp-dir\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057772 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-dshm\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057772 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-model-cache\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057772 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqn6\" (UniqueName: \"kubernetes.io/projected/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-kube-api-access-mkqn6\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057772 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tls-certs\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.057981 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.057920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-home\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.058463 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.058437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-model-cache\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.058845 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.058819    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tmp-dir\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.060212 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.060190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-dshm\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.060690 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.060667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tls-certs\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.067131 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.067099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqn6\" (UniqueName: \"kubernetes.io/projected/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-kube-api-access-mkqn6\") pod \"e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") " pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.072051 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.072020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:48.263014 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.262987    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"]
Jul 20 14:11:48.265230 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:11:48.265196    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ec087b5_6e59_4ed1_829f_3617ec9e31cf.slice/crio-f0620f93b65d15b1b8e5e7e2d9521c79a7f356287ae31d9e6337ff1a3514d5ff WatchSource:0}: Error finding container f0620f93b65d15b1b8e5e7e2d9521c79a7f356287ae31d9e6337ff1a3514d5ff: Status 404 returned error can't find the container with id f0620f93b65d15b1b8e5e7e2d9521c79a7f356287ae31d9e6337ff1a3514d5ff
Jul 20 14:11:48.306970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.306945    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:11:48.352661 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.352623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx" event={"ID":"9ec087b5-6e59-4ed1-829f-3617ec9e31cf","Type":"ContainerStarted","Data":"c9bf76e7fd756c9176315d60e5a1f1beb90922ba104bdd1c32d0f3852cf454dd"}
Jul 20 14:11:48.352827 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.352690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx" event={"ID":"9ec087b5-6e59-4ed1-829f-3617ec9e31cf","Type":"ContainerStarted","Data":"f0620f93b65d15b1b8e5e7e2d9521c79a7f356287ae31d9e6337ff1a3514d5ff"}
Jul 20 14:11:48.371075 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:48.371016    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx" podStartSLOduration=1.3709946419999999 podStartE2EDuration="1.370994642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:11:48.368910713 +0000 UTC m=+2013.644155241" watchObservedRunningTime="2026-07-20 14:11:48.370994642 +0000 UTC m=+2013.646239171"
Jul 20 14:11:51.372703 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:51.372611    2559 generic.go:356] "Generic (PLEG): container finished" podID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerID="1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7" exitCode=0
Jul 20 14:11:51.372703 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:51.372688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" event={"ID":"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf","Type":"ContainerDied","Data":"1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"}
Jul 20 14:11:51.373271 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:51.373094    2559 scope.go:117] "RemoveContainer" containerID="1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"
Jul 20 14:11:51.374110 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:51.374079    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:51.374244 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:51.374145    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:51.374244 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:51.374193    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:11:52.379781 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:52.379741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" event={"ID":"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf","Type":"ContainerStarted","Data":"fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951"}
Jul 20 14:11:52.513779 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:52.513743    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:52.515006 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:52.514973    2559 patch_prober.go:28] interesting pod/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 14:11:52.515250 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:52.515225    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 14:11:53.514181 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:53.514111    2559 patch_prober.go:28] interesting pod/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 14:11:53.514871 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:53.514837    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 14:11:54.513506 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:54.513466    2559 patch_prober.go:28] interesting pod/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 14:11:54.513816 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:54.513775    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 14:11:55.280887 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:55.280852    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:55.514205 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:55.514134    2559 patch_prober.go:28] interesting pod/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 20 14:11:55.514419 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:55.514233    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 20 14:11:56.517495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:56.517458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:56.518483 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:56.518465    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:11:58.072983 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:58.072919    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:58.073444 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:58.073001    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:58.085516 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:58.085491    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:11:58.425999 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:11:58.425962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:12:23.479881 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.479837    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"]
Jul 20 14:12:23.480547 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.480084    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw" podUID="a8c73586-d3cc-46bc-9981-f275a70207d0" containerName="maas-api" containerID="cri-o://8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6" gracePeriod=30
Jul 20 14:12:23.737211 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.737110    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:12:23.899258 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.899214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vth22\" (UniqueName: \"kubernetes.io/projected/a8c73586-d3cc-46bc-9981-f275a70207d0-kube-api-access-vth22\") pod \"a8c73586-d3cc-46bc-9981-f275a70207d0\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") "
Jul 20 14:12:23.899437 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.899342    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c73586-d3cc-46bc-9981-f275a70207d0-openshift-service-ca\") pod \"a8c73586-d3cc-46bc-9981-f275a70207d0\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") "
Jul 20 14:12:23.899437 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.899386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c73586-d3cc-46bc-9981-f275a70207d0-maas-api-tls\") pod \"a8c73586-d3cc-46bc-9981-f275a70207d0\" (UID: \"a8c73586-d3cc-46bc-9981-f275a70207d0\") "
Jul 20 14:12:23.899675 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.899650    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8c73586-d3cc-46bc-9981-f275a70207d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8c73586-d3cc-46bc-9981-f275a70207d0" (UID: "a8c73586-d3cc-46bc-9981-f275a70207d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:12:23.901662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.901634    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8c73586-d3cc-46bc-9981-f275a70207d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8c73586-d3cc-46bc-9981-f275a70207d0" (UID: "a8c73586-d3cc-46bc-9981-f275a70207d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:12:23.901771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:23.901735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8c73586-d3cc-46bc-9981-f275a70207d0-kube-api-access-vth22" (OuterVolumeSpecName: "kube-api-access-vth22") pod "a8c73586-d3cc-46bc-9981-f275a70207d0" (UID: "a8c73586-d3cc-46bc-9981-f275a70207d0"). InnerVolumeSpecName "kube-api-access-vth22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:12:24.000512 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.000419    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c73586-d3cc-46bc-9981-f275a70207d0-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:24.000512 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.000450    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c73586-d3cc-46bc-9981-f275a70207d0-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:24.000512 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.000461    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vth22\" (UniqueName: \"kubernetes.io/projected/a8c73586-d3cc-46bc-9981-f275a70207d0-kube-api-access-vth22\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:24.556473 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.556438    2559 generic.go:356] "Generic (PLEG): container finished" podID="a8c73586-d3cc-46bc-9981-f275a70207d0" containerID="8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6" exitCode=0
Jul 20 14:12:24.556907 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.556489    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"
Jul 20 14:12:24.556907 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.556526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw" event={"ID":"a8c73586-d3cc-46bc-9981-f275a70207d0","Type":"ContainerDied","Data":"8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6"}
Jul 20 14:12:24.556907 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.556581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw" event={"ID":"a8c73586-d3cc-46bc-9981-f275a70207d0","Type":"ContainerDied","Data":"eb0bfb754cca2450b15d6fee5db324808af32910cdd48c3fe45fb3c3a560a574"}
Jul 20 14:12:24.556907 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.556612    2559 scope.go:117] "RemoveContainer" containerID="8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6"
Jul 20 14:12:24.566649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.566625    2559 scope.go:117] "RemoveContainer" containerID="8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6"
Jul 20 14:12:24.566937 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:12:24.566919    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6\": container with ID starting with 8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6 not found: ID does not exist" containerID="8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6"
Jul 20 14:12:24.567008 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.566946    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6"} err="failed to get container status \"8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6\": rpc error: code = NotFound desc = could not find container \"8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6\": container with ID starting with 8a081777b35b637330a0b42042bf201e00bc55814cb7bd7ca80200d0721c32c6 not found: ID does not exist"
Jul 20 14:12:24.578637 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.578598    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"]
Jul 20 14:12:24.580570 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:24.580547    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-17600a65-8b46b575b-5c4qw"]
Jul 20 14:12:25.197262 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:25.197225    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8c73586-d3cc-46bc-9981-f275a70207d0" path="/var/lib/kubelet/pods/a8c73586-d3cc-46bc-9981-f275a70207d0/volumes"
Jul 20 14:12:35.468973 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:35.468939    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"]
Jul 20 14:12:50.490016 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.489945    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx" podUID="9ec087b5-6e59-4ed1-829f-3617ec9e31cf" containerName="main" containerID="cri-o://c9bf76e7fd756c9176315d60e5a1f1beb90922ba104bdd1c32d0f3852cf454dd" gracePeriod=45
Jul 20 14:12:50.697732 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.697700    2559 generic.go:356] "Generic (PLEG): container finished" podID="9ec087b5-6e59-4ed1-829f-3617ec9e31cf" containerID="c9bf76e7fd756c9176315d60e5a1f1beb90922ba104bdd1c32d0f3852cf454dd" exitCode=0
Jul 20 14:12:50.697898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.697772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx" event={"ID":"9ec087b5-6e59-4ed1-829f-3617ec9e31cf","Type":"ContainerDied","Data":"c9bf76e7fd756c9176315d60e5a1f1beb90922ba104bdd1c32d0f3852cf454dd"}
Jul 20 14:12:50.745396 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.745336    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:12:50.859929 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.859897    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-home\") pod \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") "
Jul 20 14:12:50.860145 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.859954    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkqn6\" (UniqueName: \"kubernetes.io/projected/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-kube-api-access-mkqn6\") pod \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") "
Jul 20 14:12:50.860145 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.859982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tls-certs\") pod \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") "
Jul 20 14:12:50.860145 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tmp-dir\") pod \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") "
Jul 20 14:12:50.860145 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-model-cache\") pod \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") "
Jul 20 14:12:50.860145 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860102    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-dshm\") pod \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\" (UID: \"9ec087b5-6e59-4ed1-829f-3617ec9e31cf\") "
Jul 20 14:12:50.860441 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-home" (OuterVolumeSpecName: "home") pod "9ec087b5-6e59-4ed1-829f-3617ec9e31cf" (UID: "9ec087b5-6e59-4ed1-829f-3617ec9e31cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:12:50.860441 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860318    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ec087b5-6e59-4ed1-829f-3617ec9e31cf" (UID: "9ec087b5-6e59-4ed1-829f-3617ec9e31cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:12:50.860441 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860394    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ec087b5-6e59-4ed1-829f-3617ec9e31cf" (UID: "9ec087b5-6e59-4ed1-829f-3617ec9e31cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:12:50.860557 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860509    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tmp-dir\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:50.860557 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860528    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-model-cache\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:50.860557 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.860540    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-home\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:50.862434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.862402    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-dshm" (OuterVolumeSpecName: "dshm") pod "9ec087b5-6e59-4ed1-829f-3617ec9e31cf" (UID: "9ec087b5-6e59-4ed1-829f-3617ec9e31cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:12:50.862542 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.862522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ec087b5-6e59-4ed1-829f-3617ec9e31cf" (UID: "9ec087b5-6e59-4ed1-829f-3617ec9e31cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:12:50.862600 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.862542    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-kube-api-access-mkqn6" (OuterVolumeSpecName: "kube-api-access-mkqn6") pod "9ec087b5-6e59-4ed1-829f-3617ec9e31cf" (UID: "9ec087b5-6e59-4ed1-829f-3617ec9e31cf"). InnerVolumeSpecName "kube-api-access-mkqn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:12:50.961857 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.961818    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-dshm\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:50.961857 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.961849    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkqn6\" (UniqueName: \"kubernetes.io/projected/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-kube-api-access-mkqn6\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:50.961857 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:50.961860    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ec087b5-6e59-4ed1-829f-3617ec9e31cf-tls-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:12:51.705358 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:51.705327    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"
Jul 20 14:12:51.705838 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:51.705370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx" event={"ID":"9ec087b5-6e59-4ed1-829f-3617ec9e31cf","Type":"ContainerDied","Data":"f0620f93b65d15b1b8e5e7e2d9521c79a7f356287ae31d9e6337ff1a3514d5ff"}
Jul 20 14:12:51.705838 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:51.705424    2559 scope.go:117] "RemoveContainer" containerID="c9bf76e7fd756c9176315d60e5a1f1beb90922ba104bdd1c32d0f3852cf454dd"
Jul 20 14:12:51.721219 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:51.721178    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"]
Jul 20 14:12:51.723553 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:51.723529    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-17600a65/e2e-lifecycle-model-17600a65-kserve-d4cbd7d67-6hzgx"]
Jul 20 14:12:53.193356 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:12:53.193319    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec087b5-6e59-4ed1-829f-3617ec9e31cf" path="/var/lib/kubelet/pods/9ec087b5-6e59-4ed1-829f-3617ec9e31cf/volumes"
Jul 20 14:13:16.538189 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:16.538147    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:13:16.546789 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:16.546760    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:13:18.483854 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:18.483820    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"]
Jul 20 14:13:18.484273 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:18.484060    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy" containerID="cri-o://fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951" gracePeriod=30
Jul 20 14:13:23.747707 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.747635    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:13:23.749094 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749072    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-data\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749251 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749115    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-credential-socket\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749251 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749189    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-podinfo\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749251 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749234    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-token\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749428 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istiod-ca-cert\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749428 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-socket\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749534 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749434    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5cwb\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-kube-api-access-j5cwb\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749534 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:13:23.749646 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749545    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-certs\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749646 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:13:23.749646 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749613    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-envoy\") pod \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\" (UID: \"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf\") "
Jul 20 14:13:23.749861 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749814    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:13:23.749861 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749830    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:13:23.750029 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749919    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.750029 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749938    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.750029 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749953    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.750029 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749966    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.750029 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.749983    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:13:23.751865 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.751839    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:13:23.752003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.751862    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:13:23.752003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.751872    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-kube-api-access-j5cwb" (OuterVolumeSpecName: "kube-api-access-j5cwb") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "kube-api-access-j5cwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:13:23.752003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.751941    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" (UID: "b8f45e1b-192d-4cfb-bc20-7ca0b0951daf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:13:23.851235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.851200    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.851235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.851228    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.851235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.851239    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5cwb\" (UniqueName: \"kubernetes.io/projected/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-kube-api-access-j5cwb\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.851491 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.851249    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.851491 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.851257    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:13:23.874173 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.874136    2559 generic.go:356] "Generic (PLEG): container finished" podID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerID="fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951" exitCode=0
Jul 20 14:13:23.874346 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.874187    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" event={"ID":"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf","Type":"ContainerDied","Data":"fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951"}
Jul 20 14:13:23.874346 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.874220    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"
Jul 20 14:13:23.874346 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.874264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4" event={"ID":"b8f45e1b-192d-4cfb-bc20-7ca0b0951daf","Type":"ContainerDied","Data":"a96dcf8da7a2cd3e74eaabb484537625a68e4cbdb33c740e313311853434caa7"}
Jul 20 14:13:23.874346 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.874296    2559 scope.go:117] "RemoveContainer" containerID="fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951"
Jul 20 14:13:23.884527 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.884501    2559 scope.go:117] "RemoveContainer" containerID="1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"
Jul 20 14:13:23.893841 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.893818    2559 scope.go:117] "RemoveContainer" containerID="fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951"
Jul 20 14:13:23.894243 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:13:23.894177    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951\": container with ID starting with fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951 not found: ID does not exist" containerID="fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951"
Jul 20 14:13:23.894243 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.894221    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951"} err="failed to get container status \"fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951\": rpc error: code = NotFound desc = could not find container \"fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951\": container with ID starting with fb242400e1abcf0988788b63ea1b3b91511f0fa9440489126584a91f704da951 not found: ID does not exist"
Jul 20 14:13:23.894388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.894249    2559 scope.go:117] "RemoveContainer" containerID="1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"
Jul 20 14:13:23.894595 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:13:23.894571    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7\": container with ID starting with 1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7 not found: ID does not exist" containerID="1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"
Jul 20 14:13:23.894679 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.894606    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7"} err="failed to get container status \"1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7\": rpc error: code = NotFound desc = could not find container \"1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7\": container with ID starting with 1e9cec9c7854f658ac5fcfa2b222b7fe8b0305b2c5b94546e12a4761f47fa4e7 not found: ID does not exist"
Jul 20 14:13:23.897297 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.897268    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"]
Jul 20 14:13:23.899289 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:23.899268    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-17600a65-openshift-default-6cd857b7f9-vjsq4"]
Jul 20 14:13:25.193695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:25.193648    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" path="/var/lib/kubelet/pods/b8f45e1b-192d-4cfb-bc20-7ca0b0951daf/volumes"
Jul 20 14:13:26.483925 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:26.483897    2559 scope.go:117] "RemoveContainer" containerID="76f843fb579d701642d1f2f002fa0ce9340fd21b39b470fc63efefa10996e616"
Jul 20 14:13:26.492516 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:13:26.492496    2559 scope.go:117] "RemoveContainer" containerID="e935b3654812c15e16de12de0479be782c6fee0ae9d112bfa14c6523f5dcb2e7"
Jul 20 14:14:15.272019 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.271986    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"]
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272407    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272419    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272430    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8c73586-d3cc-46bc-9981-f275a70207d0" containerName="maas-api"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272435    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8c73586-d3cc-46bc-9981-f275a70207d0" containerName="maas-api"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272443    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272450    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272457    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec087b5-6e59-4ed1-829f-3617ec9e31cf" containerName="main"
Jul 20 14:14:15.272464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272462    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec087b5-6e59-4ed1-829f-3617ec9e31cf" containerName="main"
Jul 20 14:14:15.272716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272530    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8c73586-d3cc-46bc-9981-f275a70207d0" containerName="maas-api"
Jul 20 14:14:15.272716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272538    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy"
Jul 20 14:14:15.272716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272546    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f45e1b-192d-4cfb-bc20-7ca0b0951daf" containerName="istio-proxy"
Jul 20 14:14:15.272716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.272550    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec087b5-6e59-4ed1-829f-3617ec9e31cf" containerName="main"
Jul 20 14:14:15.274482 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.274465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.278360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.278338    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-13affc-openshift-default-dockercfg-67rhh\""
Jul 20 14:14:15.290858 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.290822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"]
Jul 20 14:14:15.326092 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e263681-57a3-4e43-be01-5a01dc2bf314-istiod-ca-cert\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326320 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-socket\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326320 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-token\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326320 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-credential-socket\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326320 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-envoy\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326320 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-data\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326320 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-podinfo\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326529 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcbvk\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-kube-api-access-mcbvk\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.326529 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.326375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-certs\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427445 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-credential-socket\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427445 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-envoy\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427732 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-data\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427732 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-podinfo\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427732 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcbvk\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-kube-api-access-mcbvk\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427732 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-certs\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e263681-57a3-4e43-be01-5a01dc2bf314-istiod-ca-cert\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-socket\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-token\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427871    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-credential-socket\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.427949 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.427919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-data\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.428262 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.428238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-socket\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.428325 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.428261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-certs\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.428545 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.428416    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e263681-57a3-4e43-be01-5a01dc2bf314-istiod-ca-cert\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.430153 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.430133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-envoy\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.430308 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.430253    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-podinfo\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.436807 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.436775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-token\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.436965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.436861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcbvk\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-kube-api-access-mcbvk\") pod \"e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") " pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.585682 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.585591    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:15.732572 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.732535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"]
Jul 20 14:14:15.736004 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:14:15.735973    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e263681_57a3_4e43_be01_5a01dc2bf314.slice/crio-0b48da0d32dfd569bfe33e37ff992f8688c363b8c1c5df1c043f89a3fec739c1 WatchSource:0}: Error finding container 0b48da0d32dfd569bfe33e37ff992f8688c363b8c1c5df1c043f89a3fec739c1: Status 404 returned error can't find the container with id 0b48da0d32dfd569bfe33e37ff992f8688c363b8c1c5df1c043f89a3fec739c1
Jul 20 14:14:15.738071 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.738036    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:15.738152 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.738103    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:15.738152 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:15.738132    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:16.153445 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:16.153405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" event={"ID":"9e263681-57a3-4e43-be01-5a01dc2bf314","Type":"ContainerStarted","Data":"c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"}
Jul 20 14:14:16.153702 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:16.153473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" event={"ID":"9e263681-57a3-4e43-be01-5a01dc2bf314","Type":"ContainerStarted","Data":"0b48da0d32dfd569bfe33e37ff992f8688c363b8c1c5df1c043f89a3fec739c1"}
Jul 20 14:14:16.175974 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:16.175919    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podStartSLOduration=1.175900064 podStartE2EDuration="1.175900064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:14:16.17351637 +0000 UTC m=+2161.448760902" watchObservedRunningTime="2026-07-20 14:14:16.175900064 +0000 UTC m=+2161.451144594"
Jul 20 14:14:16.586895 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:16.586799    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:16.592237 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:16.592211    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:17.158749 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:17.158713    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:17.159812 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:17.159788    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:18.455809 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.455774    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"]
Jul 20 14:14:18.458603 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.458582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.461003 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.460978    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-13affc-serving-cert\""
Jul 20 14:14:18.471647 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.471621    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"]
Jul 20 14:14:18.557804 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.557759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.557804 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.557810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwt98\" (UniqueName: \"kubernetes.io/projected/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-kube-api-access-bwt98\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.558117 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.557930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-maas-api-tls\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.658906 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.658871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.658906 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.658911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwt98\" (UniqueName: \"kubernetes.io/projected/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-kube-api-access-bwt98\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.659252 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.658962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-maas-api-tls\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.659642 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.659615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.661601 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.661583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-maas-api-tls\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.669354 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.669322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwt98\" (UniqueName: \"kubernetes.io/projected/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-kube-api-access-bwt98\") pod \"maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.773779 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.773663    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:18.921655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:18.921629    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"]
Jul 20 14:14:18.924586 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:14:18.924556    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a36be9b_696d_4cbd_a3ef_d22d7708fed5.slice/crio-082ad8a7ce6abb0e23c714fb1430d7a5b74a2523fe397df36f25e628a3f933b6 WatchSource:0}: Error finding container 082ad8a7ce6abb0e23c714fb1430d7a5b74a2523fe397df36f25e628a3f933b6: Status 404 returned error can't find the container with id 082ad8a7ce6abb0e23c714fb1430d7a5b74a2523fe397df36f25e628a3f933b6
Jul 20 14:14:19.169793 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:19.169756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc" event={"ID":"2a36be9b-696d-4cbd-a3ef-d22d7708fed5","Type":"ContainerStarted","Data":"082ad8a7ce6abb0e23c714fb1430d7a5b74a2523fe397df36f25e628a3f933b6"}
Jul 20 14:14:20.176337 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:20.176298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc" event={"ID":"2a36be9b-696d-4cbd-a3ef-d22d7708fed5","Type":"ContainerStarted","Data":"d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab"}
Jul 20 14:14:20.176723 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:20.176393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:23.589721 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.589650    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc" podStartSLOduration=5.165149196 podStartE2EDuration="5.589625467s" totalImagesPullingTime="424.476271ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:14:20.206204317 +0000 UTC m=+2165.481448842" watchObservedRunningTime="2026-07-20 14:14:23.589625467 +0000 UTC m=+2168.864869997"
Jul 20 14:14:23.591985 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.591950    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"]
Jul 20 14:14:23.595276 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.595250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.598151 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.598125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ea5ee7-openshift-default-dockercfg-mh2p9\""
Jul 20 14:14:23.608279 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.608249    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"]
Jul 20 14:14:23.708511 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-socket\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708511 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-certs\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708764 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-data\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708764 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istiod-ca-cert\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708764 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-credential-socket\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708764 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-envoy\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708924 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kzr\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-kube-api-access-s4kzr\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708924 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-token\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.708924 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.708864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-podinfo\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810380 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-certs\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810380 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-data\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istiod-ca-cert\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-credential-socket\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-envoy\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kzr\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-kube-api-access-s4kzr\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-token\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810649 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-podinfo\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-socket\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-certs\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.810947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.810889    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-data\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.811126 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.811101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istiod-ca-cert\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.811230 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.811213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-credential-socket\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.811305 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.811287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-socket\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.813000 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.812980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-envoy\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.813627 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.813607    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-podinfo\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.819477 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.819454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-token\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.819629 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.819612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kzr\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-kube-api-access-s4kzr\") pod \"e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") " pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:23.907417 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:23.907374    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:24.055089 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.055065    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"]
Jul 20 14:14:24.057447 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:14:24.057417    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2540eae_c20a_4827_b8b2_3459c9d37d4f.slice/crio-ab35145cc3e5d6e284fba8b7c6dd5aabf55d47a30b7a77ca338d2870752fb539 WatchSource:0}: Error finding container ab35145cc3e5d6e284fba8b7c6dd5aabf55d47a30b7a77ca338d2870752fb539: Status 404 returned error can't find the container with id ab35145cc3e5d6e284fba8b7c6dd5aabf55d47a30b7a77ca338d2870752fb539
Jul 20 14:14:24.060171 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.060121    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:24.060260 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.060214    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:24.060260 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.060244    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:24.202235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.202127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" event={"ID":"a2540eae-c20a-4827-b8b2-3459c9d37d4f","Type":"ContainerStarted","Data":"99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"}
Jul 20 14:14:24.202235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.202209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" event={"ID":"a2540eae-c20a-4827-b8b2-3459c9d37d4f","Type":"ContainerStarted","Data":"ab35145cc3e5d6e284fba8b7c6dd5aabf55d47a30b7a77ca338d2870752fb539"}
Jul 20 14:14:24.908257 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:24.908221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:25.919034 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:25.918991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:25.947048 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:25.946977    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" podStartSLOduration=2.946962162 podStartE2EDuration="2.946962162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:14:24.222275713 +0000 UTC m=+2169.497520236" watchObservedRunningTime="2026-07-20 14:14:25.946962162 +0000 UTC m=+2171.222206691"
Jul 20 14:14:26.188085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.187984    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:14:26.216264 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.216229    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:26.218250 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.218216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:26.383883 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.383845    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"]
Jul 20 14:14:26.386476 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.386449    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.395186 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.394483    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ea5ee7-serving-cert\""
Jul 20 14:14:26.434773 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.433834    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"]
Jul 20 14:14:26.530746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.530623    2559 scope.go:117] "RemoveContainer" containerID="a80a4ec04721daef3f77b727121c3c62427385677db28df3d84868b7e385165a"
Jul 20 14:14:26.543523 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.543490    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.543675 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.543593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25n6z\" (UniqueName: \"kubernetes.io/projected/2602d65e-a0bd-459e-b2ef-c1602c49126a-kube-api-access-25n6z\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.543675 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.543636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602d65e-a0bd-459e-b2ef-c1602c49126a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.644777 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.644737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.644938 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.644797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25n6z\" (UniqueName: \"kubernetes.io/projected/2602d65e-a0bd-459e-b2ef-c1602c49126a-kube-api-access-25n6z\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.644938 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.644826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602d65e-a0bd-459e-b2ef-c1602c49126a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.644938 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:14:26.644907    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-serving-cert: secret "maas-api-e2e-inf-b-ea5ee7-serving-cert" not found
Jul 20 14:14:26.645069 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:14:26.645008    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls podName:2602d65e-a0bd-459e-b2ef-c1602c49126a nodeName:}" failed. No retries permitted until 2026-07-20 14:14:27.144985111 +0000 UTC m=+2172.420229617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls") pod "maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" (UID: "2602d65e-a0bd-459e-b2ef-c1602c49126a") : secret "maas-api-e2e-inf-b-ea5ee7-serving-cert" not found
Jul 20 14:14:26.645628 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.645608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602d65e-a0bd-459e-b2ef-c1602c49126a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:26.653848 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:26.653825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25n6z\" (UniqueName: \"kubernetes.io/projected/2602d65e-a0bd-459e-b2ef-c1602c49126a-kube-api-access-25n6z\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:27.150595 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:27.150548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:27.153196 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:27.153150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls\") pod \"maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:27.319225 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:27.318923    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:27.507029 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:27.506989    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"]
Jul 20 14:14:27.520897 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:14:27.520797    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2602d65e_a0bd_459e_b2ef_c1602c49126a.slice/crio-e4073debe793a7fb96e33e1b9e0b44ea5a4c7cecb8398620e2703910b160f49b WatchSource:0}: Error finding container e4073debe793a7fb96e33e1b9e0b44ea5a4c7cecb8398620e2703910b160f49b: Status 404 returned error can't find the container with id e4073debe793a7fb96e33e1b9e0b44ea5a4c7cecb8398620e2703910b160f49b
Jul 20 14:14:28.229432 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:28.229394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" event={"ID":"2602d65e-a0bd-459e-b2ef-c1602c49126a","Type":"ContainerStarted","Data":"35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809"}
Jul 20 14:14:28.229867 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:28.229447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" event={"ID":"2602d65e-a0bd-459e-b2ef-c1602c49126a","Type":"ContainerStarted","Data":"e4073debe793a7fb96e33e1b9e0b44ea5a4c7cecb8398620e2703910b160f49b"}
Jul 20 14:14:28.229867 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:28.229626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:28.248272 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:28.248219    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" podStartSLOduration=1.9384703380000001 podStartE2EDuration="2.248199855s" totalImagesPullingTime="309.729517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:14:28.247106278 +0000 UTC m=+2173.522350808" watchObservedRunningTime="2026-07-20 14:14:28.248199855 +0000 UTC m=+2173.523444384"
Jul 20 14:14:32.462054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:32.461665    2559 patch_prober.go:28] interesting pod/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:54560->10.132.0.66:15021: read: connection reset by peer" start-of-body=
Jul 20 14:14:32.462054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:32.461750    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:54560->10.132.0.66:15021: read: connection reset by peer"
Jul 20 14:14:33.258351 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:33.258313    2559 generic.go:356] "Generic (PLEG): container finished" podID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerID="c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e" exitCode=0
Jul 20 14:14:33.258546 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:33.258368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" event={"ID":"9e263681-57a3-4e43-be01-5a01dc2bf314","Type":"ContainerDied","Data":"c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"}
Jul 20 14:14:33.258767 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:33.258754    2559 scope.go:117] "RemoveContainer" containerID="c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"
Jul 20 14:14:33.259789 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:33.259754    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:33.259889 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:33.259866    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:33.259956 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:33.259914    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:34.240118 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:34.240090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:14:34.267382 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:34.267345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" event={"ID":"9e263681-57a3-4e43-be01-5a01dc2bf314","Type":"ContainerStarted","Data":"89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3"}
Jul 20 14:14:34.586704 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:34.586606    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:34.586957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:34.586930    2559 patch_prober.go:28] interesting pod/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 14:14:34.587016 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:34.586991    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 14:14:35.586551 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:35.586508    2559 patch_prober.go:28] interesting pod/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 14:14:35.587043 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:35.586579    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 14:14:36.586651 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:36.586614    2559 patch_prober.go:28] interesting pod/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 14:14:36.587085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:36.586680    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 14:14:37.586235 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:37.586195    2559 patch_prober.go:28] interesting pod/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 14:14:37.586423 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:37.586253    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 14:14:38.587103 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:38.587054    2559 patch_prober.go:28] interesting pod/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 20 14:14:38.587521 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:38.587135    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 20 14:14:39.589827 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:39.589795    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:39.590250 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:39.590207    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:39.591258 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:39.591230    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:14:40.306042 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:40.306012    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerID="99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b" exitCode=0
Jul 20 14:14:40.306287 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:40.306090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" event={"ID":"a2540eae-c20a-4827-b8b2-3459c9d37d4f","Type":"ContainerDied","Data":"99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"}
Jul 20 14:14:40.306629 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:40.306612    2559 scope.go:117] "RemoveContainer" containerID="99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"
Jul 20 14:14:40.307548 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:40.307522    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:40.307608 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:40.307594    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:40.307645 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:40.307630    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:14:41.215936 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:41.215893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:41.317417 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:41.317359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" event={"ID":"a2540eae-c20a-4827-b8b2-3459c9d37d4f","Type":"ContainerStarted","Data":"372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9"}
Jul 20 14:14:41.910132 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:41.909501    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:41.910132 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:41.909796    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 14:14:41.910132 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:41.909850    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 14:14:42.908619 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:42.908567    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 14:14:42.909138 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:42.908658    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 14:14:43.908609 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:43.908568    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 14:14:43.909031 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:43.908993    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 14:14:44.908238 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:44.908198    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 20 14:14:44.908543 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:44.908511    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 20 14:14:45.912634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:45.912599    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:45.913014 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:45.912989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:45.913837 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:45.913814    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:14:48.953703 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.953662    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"]
Jul 20 14:14:48.957516 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.957495    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:48.960695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.960673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-13affc\"/\"default-dockercfg-kgqdm\""
Jul 20 14:14:48.960695 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.960690    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-13affc\"/\"kube-root-ca.crt\""
Jul 20 14:14:48.960888 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.960673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-13affc\"/\"test-model-13affc-kserve-self-signed-certs\""
Jul 20 14:14:48.960888 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.960673    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-13affc\"/\"openshift-service-ca.crt\""
Jul 20 14:14:48.966498 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.966475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"]
Jul 20 14:14:48.974661 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.974637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-dshm\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:48.974771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.974726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5znq2\" (UniqueName: \"kubernetes.io/projected/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-kube-api-access-5znq2\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:48.974835 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.974766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-home\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:48.974835 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.974814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-model-cache\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:48.974945 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.974890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tls-certs\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:48.974945 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:48.974913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tmp-dir\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076037 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.075995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5znq2\" (UniqueName: \"kubernetes.io/projected/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-kube-api-access-5znq2\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076037 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-home\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076362 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-model-cache\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076362 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tls-certs\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076362 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tmp-dir\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076362 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-dshm\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076621 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-home\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076621 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076534    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-model-cache\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.076621 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.076573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tmp-dir\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.078718 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.078694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-dshm\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.078974 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.078957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tls-certs\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.087236 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.087207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5znq2\" (UniqueName: \"kubernetes.io/projected/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-kube-api-access-5znq2\") pod \"test-model-13affc-kserve-66df6bbbb5-nbbs7\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") " pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.268536 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.268444    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:49.440979 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:49.440945    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"]
Jul 20 14:14:49.443523 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:14:49.443493    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fad1fdc_8e03_4413_b6b7_5f55fd6b9783.slice/crio-019a3298e4d3c055062dbe74d5e0d9a90c1b891fa22a30036e5055cd6bc3e9ab WatchSource:0}: Error finding container 019a3298e4d3c055062dbe74d5e0d9a90c1b891fa22a30036e5055cd6bc3e9ab: Status 404 returned error can't find the container with id 019a3298e4d3c055062dbe74d5e0d9a90c1b891fa22a30036e5055cd6bc3e9ab
Jul 20 14:14:50.367953 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:50.367911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7" event={"ID":"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783","Type":"ContainerStarted","Data":"98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412"}
Jul 20 14:14:50.368401 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:50.367961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7" event={"ID":"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783","Type":"ContainerStarted","Data":"019a3298e4d3c055062dbe74d5e0d9a90c1b891fa22a30036e5055cd6bc3e9ab"}
Jul 20 14:14:50.386802 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:50.386745    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7" podStartSLOduration=2.386728646 podStartE2EDuration="2.386728646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:14:50.384686834 +0000 UTC m=+2195.659931364" watchObservedRunningTime="2026-07-20 14:14:50.386728646 +0000 UTC m=+2195.661973175"
Jul 20 14:14:59.269060 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:59.269019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:59.269613 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:59.269073    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:59.281970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:59.281932    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:14:59.433046 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:14:59.433014    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:15:26.561008 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:15:26.560974    2559 scope.go:117] "RemoveContainer" containerID="cf99308146ecd51856fe2bf82af7ca595265a876debbe95cab4af33dd4a48b90"
Jul 20 14:16:16.910401 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:16.910368    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"]
Jul 20 14:16:28.371911 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.371874    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"]
Jul 20 14:16:28.372478 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.372097    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc" podUID="2a36be9b-696d-4cbd-a3ef-d22d7708fed5" containerName="maas-api" containerID="cri-o://d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab" gracePeriod=30
Jul 20 14:16:28.639506 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.639479    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:16:28.751860 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.751814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-maas-api-tls\") pod \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") "
Jul 20 14:16:28.752078 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.751887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-openshift-service-ca\") pod \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") "
Jul 20 14:16:28.752078 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.751955    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwt98\" (UniqueName: \"kubernetes.io/projected/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-kube-api-access-bwt98\") pod \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\" (UID: \"2a36be9b-696d-4cbd-a3ef-d22d7708fed5\") "
Jul 20 14:16:28.752308 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.752282    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a36be9b-696d-4cbd-a3ef-d22d7708fed5" (UID: "2a36be9b-696d-4cbd-a3ef-d22d7708fed5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:16:28.754293 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.754267    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a36be9b-696d-4cbd-a3ef-d22d7708fed5" (UID: "2a36be9b-696d-4cbd-a3ef-d22d7708fed5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:16:28.754360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.754342    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-kube-api-access-bwt98" (OuterVolumeSpecName: "kube-api-access-bwt98") pod "2a36be9b-696d-4cbd-a3ef-d22d7708fed5" (UID: "2a36be9b-696d-4cbd-a3ef-d22d7708fed5"). InnerVolumeSpecName "kube-api-access-bwt98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:16:28.852981 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.852938    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:28.852981 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.852969    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:28.852981 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.852980    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwt98\" (UniqueName: \"kubernetes.io/projected/2a36be9b-696d-4cbd-a3ef-d22d7708fed5-kube-api-access-bwt98\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:28.917872 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.917835    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a36be9b-696d-4cbd-a3ef-d22d7708fed5" containerID="d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab" exitCode=0
Jul 20 14:16:28.918049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.917881    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"
Jul 20 14:16:28.918049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.917917    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc" event={"ID":"2a36be9b-696d-4cbd-a3ef-d22d7708fed5","Type":"ContainerDied","Data":"d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab"}
Jul 20 14:16:28.918049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.917968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc" event={"ID":"2a36be9b-696d-4cbd-a3ef-d22d7708fed5","Type":"ContainerDied","Data":"082ad8a7ce6abb0e23c714fb1430d7a5b74a2523fe397df36f25e628a3f933b6"}
Jul 20 14:16:28.918049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.917989    2559 scope.go:117] "RemoveContainer" containerID="d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab"
Jul 20 14:16:28.928396 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.928378    2559 scope.go:117] "RemoveContainer" containerID="d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab"
Jul 20 14:16:28.928701 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:16:28.928682    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab\": container with ID starting with d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab not found: ID does not exist" containerID="d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab"
Jul 20 14:16:28.928785 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.928715    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab"} err="failed to get container status \"d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab\": rpc error: code = NotFound desc = could not find container \"d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab\": container with ID starting with d95f1481dda4354c1a363fa3de57010c8f11c0b10722b5218d4430e35835fdab not found: ID does not exist"
Jul 20 14:16:28.939852 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.939816    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"]
Jul 20 14:16:28.946126 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:28.946092    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13affc-884b9c85b-ck8sc"]
Jul 20 14:16:29.193771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:29.193687    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a36be9b-696d-4cbd-a3ef-d22d7708fed5" path="/var/lib/kubelet/pods/2a36be9b-696d-4cbd-a3ef-d22d7708fed5/volumes"
Jul 20 14:16:31.931318 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:31.931272    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7" podUID="8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" containerName="main" containerID="cri-o://98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412" gracePeriod=45
Jul 20 14:16:32.199573 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.199489    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:16:32.286891 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.286849    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-model-cache\") pod \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") "
Jul 20 14:16:32.287104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.286931    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-home\") pod \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") "
Jul 20 14:16:32.287104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.286948    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tmp-dir\") pod \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") "
Jul 20 14:16:32.287104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287000    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tls-certs\") pod \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") "
Jul 20 14:16:32.287104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-dshm\") pod \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") "
Jul 20 14:16:32.287363 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287210    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5znq2\" (UniqueName: \"kubernetes.io/projected/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-kube-api-access-5znq2\") pod \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\" (UID: \"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783\") "
Jul 20 14:16:32.287363 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287280    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-model-cache" (OuterVolumeSpecName: "model-cache") pod "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" (UID: "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:32.287363 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287320    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-home" (OuterVolumeSpecName: "home") pod "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" (UID: "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:32.287363 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287334    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" (UID: "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:32.287576 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287559    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-model-cache\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:32.287632 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287580    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-home\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:32.287632 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.287590    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tmp-dir\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:32.289444 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.289423    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-dshm" (OuterVolumeSpecName: "dshm") pod "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" (UID: "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:32.289562 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.289527    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" (UID: "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:16:32.289623 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.289607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-kube-api-access-5znq2" (OuterVolumeSpecName: "kube-api-access-5znq2") pod "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" (UID: "8fad1fdc-8e03-4413-b6b7-5f55fd6b9783"). InnerVolumeSpecName "kube-api-access-5znq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:16:32.389119 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.389080    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-tls-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:32.389119 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.389112    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-dshm\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:32.389119 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.389121    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5znq2\" (UniqueName: \"kubernetes.io/projected/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783-kube-api-access-5znq2\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:32.941315 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.941281    2559 generic.go:356] "Generic (PLEG): container finished" podID="8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" containerID="98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412" exitCode=0
Jul 20 14:16:32.941830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.941321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7" event={"ID":"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783","Type":"ContainerDied","Data":"98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412"}
Jul 20 14:16:32.941830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.941329    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"
Jul 20 14:16:32.941830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.941348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7" event={"ID":"8fad1fdc-8e03-4413-b6b7-5f55fd6b9783","Type":"ContainerDied","Data":"019a3298e4d3c055062dbe74d5e0d9a90c1b891fa22a30036e5055cd6bc3e9ab"}
Jul 20 14:16:32.941830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.941363    2559 scope.go:117] "RemoveContainer" containerID="98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412"
Jul 20 14:16:32.951555 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.951535    2559 scope.go:117] "RemoveContainer" containerID="98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412"
Jul 20 14:16:32.951873 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:16:32.951853    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412\": container with ID starting with 98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412 not found: ID does not exist" containerID="98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412"
Jul 20 14:16:32.951919 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.951884    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412"} err="failed to get container status \"98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412\": rpc error: code = NotFound desc = could not find container \"98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412\": container with ID starting with 98f1b8679459191b0a187d5c8e0c3fbf496e67ac7d24e2ebc68f3a520b370412 not found: ID does not exist"
Jul 20 14:16:32.963694 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.963660    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"]
Jul 20 14:16:32.969615 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:32.969583    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-13affc/test-model-13affc-kserve-66df6bbbb5-nbbs7"]
Jul 20 14:16:33.193963 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:33.193868    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" path="/var/lib/kubelet/pods/8fad1fdc-8e03-4413-b6b7-5f55fd6b9783/volumes"
Jul 20 14:16:39.735916 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:39.735876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"]
Jul 20 14:16:39.736436 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:39.736099    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy" containerID="cri-o://89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3" gracePeriod=30
Jul 20 14:16:44.982364 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:44.982328    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:16:45.005195 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.005071    2559 generic.go:356] "Generic (PLEG): container finished" podID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerID="89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3" exitCode=0
Jul 20 14:16:45.005195 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.005135    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"
Jul 20 14:16:45.005469 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.005186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" event={"ID":"9e263681-57a3-4e43-be01-5a01dc2bf314","Type":"ContainerDied","Data":"89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3"}
Jul 20 14:16:45.005469 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.005262    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv" event={"ID":"9e263681-57a3-4e43-be01-5a01dc2bf314","Type":"ContainerDied","Data":"0b48da0d32dfd569bfe33e37ff992f8688c363b8c1c5df1c043f89a3fec739c1"}
Jul 20 14:16:45.005469 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.005292    2559 scope.go:117] "RemoveContainer" containerID="89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3"
Jul 20 14:16:45.012726 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012537    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-envoy\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.012726 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e263681-57a3-4e43-be01-5a01dc2bf314-istiod-ca-cert\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.012726 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012634    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-data\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.012726 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012681    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-socket\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.012726 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-podinfo\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.013099 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012740    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcbvk\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-kube-api-access-mcbvk\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.013099 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012774    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-token\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.013099 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012818    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-credential-socket\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.013099 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.012840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-certs\") pod \"9e263681-57a3-4e43-be01-5a01dc2bf314\" (UID: \"9e263681-57a3-4e43-be01-5a01dc2bf314\") "
Jul 20 14:16:45.013921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.013397    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e263681-57a3-4e43-be01-5a01dc2bf314-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:16:45.013921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.013408    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:45.013921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.013596    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:45.013921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.013648    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:45.013921 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.013776    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:45.015000 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.014978    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:16:45.015670 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.015574    2559 scope.go:117] "RemoveContainer" containerID="c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"
Jul 20 14:16:45.015995 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.015973    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:16:45.016212 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.016184    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:16:45.016289 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.016191    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-kube-api-access-mcbvk" (OuterVolumeSpecName: "kube-api-access-mcbvk") pod "9e263681-57a3-4e43-be01-5a01dc2bf314" (UID: "9e263681-57a3-4e43-be01-5a01dc2bf314"). InnerVolumeSpecName "kube-api-access-mcbvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:16:45.035354 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.035331    2559 scope.go:117] "RemoveContainer" containerID="89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3"
Jul 20 14:16:45.035711 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:16:45.035688    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3\": container with ID starting with 89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3 not found: ID does not exist" containerID="89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3"
Jul 20 14:16:45.035774 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.035722    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3"} err="failed to get container status \"89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3\": rpc error: code = NotFound desc = could not find container \"89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3\": container with ID starting with 89a914958bb272285ad8baa09bfe0a31d56fe1df82f11be3930dc135e4c404f3 not found: ID does not exist"
Jul 20 14:16:45.035774 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.035740    2559 scope.go:117] "RemoveContainer" containerID="c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"
Jul 20 14:16:45.036025 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:16:45.036004    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e\": container with ID starting with c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e not found: ID does not exist" containerID="c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"
Jul 20 14:16:45.036087 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.036037    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e"} err="failed to get container status \"c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e\": rpc error: code = NotFound desc = could not find container \"c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e\": container with ID starting with c3dc4e17f250c7641a5f98c297d74f3e42b41f78a72161a9764a5358bc75e04e not found: ID does not exist"
Jul 20 14:16:45.114301 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114259    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114301 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114292    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114301 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114302    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcbvk\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-kube-api-access-mcbvk\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114558 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114311    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114558 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114322    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114558 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114330    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114558 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114337    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114558 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114345    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e263681-57a3-4e43-be01-5a01dc2bf314-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.114558 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.114351    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e263681-57a3-4e43-be01-5a01dc2bf314-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:45.321671 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.321580    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"]
Jul 20 14:16:45.326557 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:45.326520    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-13affc-openshift-default-84fc6f6c85-n6wwv"]
Jul 20 14:16:47.193080 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:47.193035    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" path="/var/lib/kubelet/pods/9e263681-57a3-4e43-be01-5a01dc2bf314/volumes"
Jul 20 14:16:50.671253 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.671216    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"]
Jul 20 14:16:50.671762 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.671463    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" podUID="2602d65e-a0bd-459e-b2ef-c1602c49126a" containerName="maas-api" containerID="cri-o://35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809" gracePeriod=30
Jul 20 14:16:50.937240 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.937215    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:16:50.971952 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.971912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls\") pod \"2602d65e-a0bd-459e-b2ef-c1602c49126a\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") "
Jul 20 14:16:50.972142 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.971976    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25n6z\" (UniqueName: \"kubernetes.io/projected/2602d65e-a0bd-459e-b2ef-c1602c49126a-kube-api-access-25n6z\") pod \"2602d65e-a0bd-459e-b2ef-c1602c49126a\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") "
Jul 20 14:16:50.972142 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.972006    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602d65e-a0bd-459e-b2ef-c1602c49126a-openshift-service-ca\") pod \"2602d65e-a0bd-459e-b2ef-c1602c49126a\" (UID: \"2602d65e-a0bd-459e-b2ef-c1602c49126a\") "
Jul 20 14:16:50.972510 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.972479    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2602d65e-a0bd-459e-b2ef-c1602c49126a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2602d65e-a0bd-459e-b2ef-c1602c49126a" (UID: "2602d65e-a0bd-459e-b2ef-c1602c49126a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:16:50.974200 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.974153    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2602d65e-a0bd-459e-b2ef-c1602c49126a-kube-api-access-25n6z" (OuterVolumeSpecName: "kube-api-access-25n6z") pod "2602d65e-a0bd-459e-b2ef-c1602c49126a" (UID: "2602d65e-a0bd-459e-b2ef-c1602c49126a"). InnerVolumeSpecName "kube-api-access-25n6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:16:50.974200 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:50.974184    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2602d65e-a0bd-459e-b2ef-c1602c49126a" (UID: "2602d65e-a0bd-459e-b2ef-c1602c49126a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:16:51.038335 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.038299    2559 generic.go:356] "Generic (PLEG): container finished" podID="2602d65e-a0bd-459e-b2ef-c1602c49126a" containerID="35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809" exitCode=0
Jul 20 14:16:51.038536 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.038348    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"
Jul 20 14:16:51.038536 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.038381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" event={"ID":"2602d65e-a0bd-459e-b2ef-c1602c49126a","Type":"ContainerDied","Data":"35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809"}
Jul 20 14:16:51.038536 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.038448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk" event={"ID":"2602d65e-a0bd-459e-b2ef-c1602c49126a","Type":"ContainerDied","Data":"e4073debe793a7fb96e33e1b9e0b44ea5a4c7cecb8398620e2703910b160f49b"}
Jul 20 14:16:51.038536 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.038478    2559 scope.go:117] "RemoveContainer" containerID="35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809"
Jul 20 14:16:51.048098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.048078    2559 scope.go:117] "RemoveContainer" containerID="35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809"
Jul 20 14:16:51.048448 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:16:51.048426    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809\": container with ID starting with 35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809 not found: ID does not exist" containerID="35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809"
Jul 20 14:16:51.048506 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.048459    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809"} err="failed to get container status \"35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809\": rpc error: code = NotFound desc = could not find container \"35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809\": container with ID starting with 35a96d480464707280a08115a9de6fb756d9fadb9cb1dd18c673412522aa2809 not found: ID does not exist"
Jul 20 14:16:51.064187 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.061047    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"]
Jul 20 14:16:51.067670 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.067640    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ea5ee7-bd4b548c9-tpskk"]
Jul 20 14:16:51.073567 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.073542    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25n6z\" (UniqueName: \"kubernetes.io/projected/2602d65e-a0bd-459e-b2ef-c1602c49126a-kube-api-access-25n6z\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:51.073653 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.073569    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602d65e-a0bd-459e-b2ef-c1602c49126a-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:51.073653 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.073582    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2602d65e-a0bd-459e-b2ef-c1602c49126a-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:16:51.195215 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:16:51.195110    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2602d65e-a0bd-459e-b2ef-c1602c49126a" path="/var/lib/kubelet/pods/2602d65e-a0bd-459e-b2ef-c1602c49126a/volumes"
Jul 20 14:17:01.620346 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:01.620306    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"]
Jul 20 14:17:01.620814 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:01.620575    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy" containerID="cri-o://372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9" gracePeriod=30
Jul 20 14:17:02.593946 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.593911    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"]
Jul 20 14:17:02.594348 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594335    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy"
Jul 20 14:17:02.594400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594350    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy"
Jul 20 14:17:02.594400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594364    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" containerName="main"
Jul 20 14:17:02.594400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594369    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" containerName="main"
Jul 20 14:17:02.594400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594377    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2602d65e-a0bd-459e-b2ef-c1602c49126a" containerName="maas-api"
Jul 20 14:17:02.594400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594383    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2602d65e-a0bd-459e-b2ef-c1602c49126a" containerName="maas-api"
Jul 20 14:17:02.594400 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594399    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a36be9b-696d-4cbd-a3ef-d22d7708fed5" containerName="maas-api"
Jul 20 14:17:02.594591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594404    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a36be9b-696d-4cbd-a3ef-d22d7708fed5" containerName="maas-api"
Jul 20 14:17:02.594591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594469    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fad1fdc-8e03-4413-b6b7-5f55fd6b9783" containerName="main"
Jul 20 14:17:02.594591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594478    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy"
Jul 20 14:17:02.594591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594484    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a36be9b-696d-4cbd-a3ef-d22d7708fed5" containerName="maas-api"
Jul 20 14:17:02.594591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594491    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2602d65e-a0bd-459e-b2ef-c1602c49126a" containerName="maas-api"
Jul 20 14:17:02.594591 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.594496    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy"
Jul 20 14:17:02.598771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.598750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.601200 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.601147    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e9d90e-openshift-default-dockercfg-4cm4k\""
Jul 20 14:17:02.610990 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.610961    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"]
Jul 20 14:17:02.685508 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-socket\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjzh\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-kube-api-access-gkjzh\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-token\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-credential-socket\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-certs\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-data\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-envoy\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-podinfo\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.686004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.685871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istiod-ca-cert\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786685 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjzh\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-kube-api-access-gkjzh\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786685 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-token\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-credential-socket\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-certs\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-data\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786832    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-envoy\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-podinfo\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786880    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istiod-ca-cert\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.786957 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.786930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-socket\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.787359 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.787252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-credential-socket\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.787359 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.787271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-data\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.787464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.787418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-socket\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.787464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.787447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-certs\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.787608 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.787590    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istiod-ca-cert\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.789483 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.789465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-envoy\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.789556 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.789542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-podinfo\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.795220 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.795194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-token\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.795657 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.795637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjzh\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-kube-api-access-gkjzh\") pod \"e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") " pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:02.909432 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:02.909396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:03.059131 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:03.059107    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"]
Jul 20 14:17:03.061369 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:17:03.061336    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc48d39_32c6_4f53_92bb_c9c42917d61d.slice/crio-1105f647db2bb2cbe9c517848c0ccdc501d24329c7ce93505ecab7263a9de14e WatchSource:0}: Error finding container 1105f647db2bb2cbe9c517848c0ccdc501d24329c7ce93505ecab7263a9de14e: Status 404 returned error can't find the container with id 1105f647db2bb2cbe9c517848c0ccdc501d24329c7ce93505ecab7263a9de14e
Jul 20 14:17:03.063513 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:03.063480    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:03.063583 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:03.063559    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:03.063625 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:03.063601    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:03.102076 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:03.102037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" event={"ID":"7cc48d39-32c6-4f53-92bb-c9c42917d61d","Type":"ContainerStarted","Data":"1105f647db2bb2cbe9c517848c0ccdc501d24329c7ce93505ecab7263a9de14e"}
Jul 20 14:17:04.109492 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:04.109450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" event={"ID":"7cc48d39-32c6-4f53-92bb-c9c42917d61d","Type":"ContainerStarted","Data":"9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"}
Jul 20 14:17:04.132834 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:04.132778    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podStartSLOduration=2.13276264 podStartE2EDuration="2.13276264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:17:04.130371876 +0000 UTC m=+2329.405616404" watchObservedRunningTime="2026-07-20 14:17:04.13276264 +0000 UTC m=+2329.408007167"
Jul 20 14:17:04.910704 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:04.910662    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:04.915644 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:04.915611    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:05.115673 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:05.115641    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:05.116724 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:05.116699    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:06.260718 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.260633    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"]
Jul 20 14:17:06.261068 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.261005    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy"
Jul 20 14:17:06.261068 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.261016    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e263681-57a3-4e43-be01-5a01dc2bf314" containerName="istio-proxy"
Jul 20 14:17:06.264010 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.263994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.270873 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.270844    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e9d90e-serving-cert\""
Jul 20 14:17:06.291288 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.291255    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"]
Jul 20 14:17:06.324392 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.324356    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-maas-api-tls\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.324580 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.324452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfcc\" (UniqueName: \"kubernetes.io/projected/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-kube-api-access-jgfcc\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.324580 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.324494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-openshift-service-ca\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.425515 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.425467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-openshift-service-ca\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.425689 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.425618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-maas-api-tls\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.425749 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.425693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfcc\" (UniqueName: \"kubernetes.io/projected/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-kube-api-access-jgfcc\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.426114 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.426088    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-openshift-service-ca\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.428291 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.428265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-maas-api-tls\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.438521 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.438496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfcc\" (UniqueName: \"kubernetes.io/projected/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-kube-api-access-jgfcc\") pod \"maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.575405 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.575314    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:06.728737 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.728707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"]
Jul 20 14:17:06.730309 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:17:06.730277    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb06bf8_c2b3_4035_bcf9_ba97708abf82.slice/crio-2e5422692d7a6730d0446d328b0b0efc30c743ca955002938359e66643db2df9 WatchSource:0}: Error finding container 2e5422692d7a6730d0446d328b0b0efc30c743ca955002938359e66643db2df9: Status 404 returned error can't find the container with id 2e5422692d7a6730d0446d328b0b0efc30c743ca955002938359e66643db2df9
Jul 20 14:17:06.731752 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.731735    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 14:17:06.869462 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.869436    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:17:06.931365 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931333    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4kzr\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-kube-api-access-s4kzr\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931557 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931399    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-certs\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931557 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-data\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931605    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-token\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931723 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931682    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-envoy\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931723 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931695    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:06.931822 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931721    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istiod-ca-cert\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931822 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931749    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-credential-socket\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931822 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931813    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-podinfo\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.931965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931867    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-socket\") pod \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\" (UID: \"a2540eae-c20a-4827-b8b2-3459c9d37d4f\") "
Jul 20 14:17:06.932038 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.931999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:06.932038 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.932018    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:17:06.932281 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.932232    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:06.932281 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.932247    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:06.932281 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.932270    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:06.932448 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.932285    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:06.932448 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.932436    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:06.933926 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.933903    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:06.934045 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.933931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:17:06.934045 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.933966    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-kube-api-access-s4kzr" (OuterVolumeSpecName: "kube-api-access-s4kzr") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "kube-api-access-s4kzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:17:06.934228 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:06.934206    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2540eae-c20a-4827-b8b2-3459c9d37d4f" (UID: "a2540eae-c20a-4827-b8b2-3459c9d37d4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:17:07.033183 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.033123    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4kzr\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-kube-api-access-s4kzr\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:07.033183 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.033155    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:07.033402 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.033199    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:07.033402 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.033209    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:07.033402 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.033217    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2540eae-c20a-4827-b8b2-3459c9d37d4f-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:07.033402 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.033224    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2540eae-c20a-4827-b8b2-3459c9d37d4f-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:07.126940 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.126850    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerID="372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9" exitCode=0
Jul 20 14:17:07.126940 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.126911    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"
Jul 20 14:17:07.126940 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.126919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" event={"ID":"a2540eae-c20a-4827-b8b2-3459c9d37d4f","Type":"ContainerDied","Data":"372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9"}
Jul 20 14:17:07.127267 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.126967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj" event={"ID":"a2540eae-c20a-4827-b8b2-3459c9d37d4f","Type":"ContainerDied","Data":"ab35145cc3e5d6e284fba8b7c6dd5aabf55d47a30b7a77ca338d2870752fb539"}
Jul 20 14:17:07.127267 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.126989    2559 scope.go:117] "RemoveContainer" containerID="372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9"
Jul 20 14:17:07.128468 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.128439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8" event={"ID":"2fb06bf8-c2b3-4035-bcf9-ba97708abf82","Type":"ContainerStarted","Data":"2e5422692d7a6730d0446d328b0b0efc30c743ca955002938359e66643db2df9"}
Jul 20 14:17:07.136635 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.136619    2559 scope.go:117] "RemoveContainer" containerID="99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"
Jul 20 14:17:07.145602 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.145581    2559 scope.go:117] "RemoveContainer" containerID="372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9"
Jul 20 14:17:07.145887 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:17:07.145867    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9\": container with ID starting with 372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9 not found: ID does not exist" containerID="372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9"
Jul 20 14:17:07.145940 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.145899    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9"} err="failed to get container status \"372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9\": rpc error: code = NotFound desc = could not find container \"372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9\": container with ID starting with 372001a92c4c8d755c8151eeef9bba7adfb34f2cc509eac2e185d6d1b70291a9 not found: ID does not exist"
Jul 20 14:17:07.145940 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.145921    2559 scope.go:117] "RemoveContainer" containerID="99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"
Jul 20 14:17:07.146194 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:17:07.146145    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b\": container with ID starting with 99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b not found: ID does not exist" containerID="99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"
Jul 20 14:17:07.146250 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.146205    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b"} err="failed to get container status \"99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b\": rpc error: code = NotFound desc = could not find container \"99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b\": container with ID starting with 99f6d0e671e94a9b2557024034634945ef3b52449ea7dc02df47c602365b127b not found: ID does not exist"
Jul 20 14:17:07.149499 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.149474    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"]
Jul 20 14:17:07.154764 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.154738    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ea5ee7-openshift-default-7fcff5cdc9-xqszj"]
Jul 20 14:17:07.196491 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:07.196449    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" path="/var/lib/kubelet/pods/a2540eae-c20a-4827-b8b2-3459c9d37d4f/volumes"
Jul 20 14:17:08.136670 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:08.136627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8" event={"ID":"2fb06bf8-c2b3-4035-bcf9-ba97708abf82","Type":"ContainerStarted","Data":"72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190"}
Jul 20 14:17:08.137109 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:08.136702    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:08.155771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:08.155711    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8" podStartSLOduration=1.690155446 podStartE2EDuration="2.155692149s" totalImagesPullingTime="465.536703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:17:08.153843868 +0000 UTC m=+2333.429088397" watchObservedRunningTime="2026-07-20 14:17:08.155692149 +0000 UTC m=+2333.430936717"
Jul 20 14:17:11.533227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.533181    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"]
Jul 20 14:17:11.533818 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.533796    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy"
Jul 20 14:17:11.533889 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.533824    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy"
Jul 20 14:17:11.533889 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.533855    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy"
Jul 20 14:17:11.533889 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.533864    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy"
Jul 20 14:17:11.533988 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.533975    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy"
Jul 20 14:17:11.537549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.537526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.540192 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.540143    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2c40e1-openshift-default-dockercfg-7r2mv\""
Jul 20 14:17:11.548948 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.548921    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"]
Jul 20 14:17:11.681865 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.681825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-credential-socket\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682046 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.681907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-certs\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682046 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.681938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istiod-ca-cert\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.681974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-podinfo\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.682112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-socket\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682286 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.682147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmsm\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-kube-api-access-6gmsm\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682286 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.682251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-envoy\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.682330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-token\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.682388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.682362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-data\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.783908 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.783806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmsm\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-kube-api-access-6gmsm\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.783908 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.783855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-envoy\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.783994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-token\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-data\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784146 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-credential-socket\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784357 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-certs\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784357 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istiod-ca-cert\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784357 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-podinfo\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784357 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-socket\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784555 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784438    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-data\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784555 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-credential-socket\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-certs\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784714 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-socket\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.784876 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.784856    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istiod-ca-cert\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.786328 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.786299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-envoy\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.786947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.786924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-podinfo\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.792104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.792063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmsm\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-kube-api-access-6gmsm\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.792352 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.792252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-token\") pod \"e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") " pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:11.848331 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:11.848287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:12.018424 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.018393    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"]
Jul 20 14:17:12.020013 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:17:12.019983    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc7be1d_9d1c_4652_b7a9_2e9e85c12b5b.slice/crio-d513ec6582f69db4201d52d686ecb4acd2e9c8ecbfa3e8e84065247fce5ae106 WatchSource:0}: Error finding container d513ec6582f69db4201d52d686ecb4acd2e9c8ecbfa3e8e84065247fce5ae106: Status 404 returned error can't find the container with id d513ec6582f69db4201d52d686ecb4acd2e9c8ecbfa3e8e84065247fce5ae106
Jul 20 14:17:12.022276 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.022241    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:12.022377 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.022331    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:12.022510 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.022374    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:12.160544 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.160507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" event={"ID":"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b","Type":"ContainerStarted","Data":"e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"}
Jul 20 14:17:12.160718 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.160563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" event={"ID":"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b","Type":"ContainerStarted","Data":"d513ec6582f69db4201d52d686ecb4acd2e9c8ecbfa3e8e84065247fce5ae106"}
Jul 20 14:17:12.180229 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.180146    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podStartSLOduration=1.180124686 podStartE2EDuration="1.180124686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:17:12.178577186 +0000 UTC m=+2337.453821726" watchObservedRunningTime="2026-07-20 14:17:12.180124686 +0000 UTC m=+2337.455369216"
Jul 20 14:17:12.848902 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:12.848864    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:13.854123 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:13.854093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:14.148344 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.148314    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:14.170964 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.170932    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:14.171980 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.171960    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:14.436053 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.435969    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"]
Jul 20 14:17:14.436698 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.436674    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2540eae-c20a-4827-b8b2-3459c9d37d4f" containerName="istio-proxy"
Jul 20 14:17:14.440238 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.440209    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.443054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.443030    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2c40e1-serving-cert\""
Jul 20 14:17:14.458605 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.458576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"]
Jul 20 14:17:14.615136 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.615080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbrlc\" (UniqueName: \"kubernetes.io/projected/058671b1-93e2-4254-ab26-e559ccc8d351-kube-api-access-xbrlc\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.615347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.615220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.615347 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.615250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/058671b1-93e2-4254-ab26-e559ccc8d351-openshift-service-ca\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.716333 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.716226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.716333 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.716282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/058671b1-93e2-4254-ab26-e559ccc8d351-openshift-service-ca\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.716586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.716396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbrlc\" (UniqueName: \"kubernetes.io/projected/058671b1-93e2-4254-ab26-e559ccc8d351-kube-api-access-xbrlc\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.716892 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:17:14.716864    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-serving-cert: secret "maas-api-e2e-api-b-2c40e1-serving-cert" not found
Jul 20 14:17:14.716984 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:17:14.716946    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls podName:058671b1-93e2-4254-ab26-e559ccc8d351 nodeName:}" failed. No retries permitted until 2026-07-20 14:17:15.216925804 +0000 UTC m=+2340.492170314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls") pod "maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" (UID: "058671b1-93e2-4254-ab26-e559ccc8d351") : secret "maas-api-e2e-api-b-2c40e1-serving-cert" not found
Jul 20 14:17:14.717869 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.717831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/058671b1-93e2-4254-ab26-e559ccc8d351-openshift-service-ca\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:14.729296 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:14.729255    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbrlc\" (UniqueName: \"kubernetes.io/projected/058671b1-93e2-4254-ab26-e559ccc8d351-kube-api-access-xbrlc\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:15.222211 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:15.222104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:15.225549 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:15.225514    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls\") pod \"maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:15.354480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:15.354438    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:15.567930 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:15.567904    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"]
Jul 20 14:17:15.570343 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:17:15.570316    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058671b1_93e2_4254_ab26_e559ccc8d351.slice/crio-0f52af80ec246edb76d0f1520715ea4f8b142d42dedc5ae0b9bb219eb5cc0af0 WatchSource:0}: Error finding container 0f52af80ec246edb76d0f1520715ea4f8b142d42dedc5ae0b9bb219eb5cc0af0: Status 404 returned error can't find the container with id 0f52af80ec246edb76d0f1520715ea4f8b142d42dedc5ae0b9bb219eb5cc0af0
Jul 20 14:17:16.183380 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:16.183341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" event={"ID":"058671b1-93e2-4254-ab26-e559ccc8d351","Type":"ContainerStarted","Data":"8c542bccc8dc444d1e532ed9253bd751fea37661b54d650b313bc42d95214d46"}
Jul 20 14:17:16.183579 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:16.183408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:16.183579 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:16.183433    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" event={"ID":"058671b1-93e2-4254-ab26-e559ccc8d351","Type":"ContainerStarted","Data":"0f52af80ec246edb76d0f1520715ea4f8b142d42dedc5ae0b9bb219eb5cc0af0"}
Jul 20 14:17:16.204594 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:16.204141    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" podStartSLOduration=1.72941999 podStartE2EDuration="2.204119208s" totalImagesPullingTime="474.699218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:17:16.200571825 +0000 UTC m=+2341.475816354" watchObservedRunningTime="2026-07-20 14:17:16.204119208 +0000 UTC m=+2341.479363737"
Jul 20 14:17:21.156406 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:21.156356    2559 patch_prober.go:28] interesting pod/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 14:17:21.156820 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:21.156431    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 14:17:22.196007 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.195975    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:17:22.222529 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.222494    2559 generic.go:356] "Generic (PLEG): container finished" podID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerID="9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c" exitCode=0
Jul 20 14:17:22.222716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.222593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" event={"ID":"7cc48d39-32c6-4f53-92bb-c9c42917d61d","Type":"ContainerDied","Data":"9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"}
Jul 20 14:17:22.223069 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.223054    2559 scope.go:117] "RemoveContainer" containerID="9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"
Jul 20 14:17:22.224330 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.224286    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:22.224426 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.224377    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:22.224465 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:22.224448    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:23.230053 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:23.230018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" event={"ID":"7cc48d39-32c6-4f53-92bb-c9c42917d61d","Type":"ContainerStarted","Data":"0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808"}
Jul 20 14:17:23.910413 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:23.910367    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:23.910668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:23.910521    2559 patch_prober.go:28] interesting pod/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 14:17:23.910668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:23.910580    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 14:17:24.910104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:24.910064    2559 patch_prober.go:28] interesting pod/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 14:17:24.910759 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:24.910722    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 14:17:25.910630 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:25.910581    2559 patch_prober.go:28] interesting pod/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 14:17:25.911186 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:25.910683    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 14:17:26.590898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:26.590859    2559 scope.go:117] "RemoveContainer" containerID="59e44cc77bf49b7d21c62788280b3b20fe448020fc190fa6edaab9050f4f0648"
Jul 20 14:17:26.910228 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:26.910182    2559 patch_prober.go:28] interesting pod/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 20 14:17:26.910467 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:26.910268    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 20 14:17:27.917930 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:27.917892    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:27.918409 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:27.918306    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:27.919246 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:27.919223    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:30.213410 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:30.213349    2559 patch_prober.go:28] interesting pod/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 14:17:30.213819 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:30.213436    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 14:17:31.284868 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:31.284773    2559 generic.go:356] "Generic (PLEG): container finished" podID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerID="e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a" exitCode=0
Jul 20 14:17:31.284868 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:31.284849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" event={"ID":"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b","Type":"ContainerDied","Data":"e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"}
Jul 20 14:17:31.285423 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:31.285324    2559 scope.go:117] "RemoveContainer" containerID="e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"
Jul 20 14:17:31.286387 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:31.286355    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:31.286517 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:31.286437    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:31.286517 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:31.286467    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:17:32.291780 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:32.291747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" event={"ID":"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b","Type":"ContainerStarted","Data":"76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04"}
Jul 20 14:17:32.848677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:32.848632    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:32.848965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:32.848941    2559 patch_prober.go:28] interesting pod/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 20 14:17:32.849030 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:32.849009    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 20 14:17:33.849659 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:33.849622    2559 patch_prober.go:28] interesting pod/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 20 14:17:33.850074 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:33.849682    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 20 14:17:34.849294 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:34.849247    2559 patch_prober.go:28] interesting pod/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 20 14:17:34.849524 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:34.849337    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 20 14:17:35.848634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:35.848601    2559 patch_prober.go:28] interesting pod/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 20 14:17:35.849084 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:35.848659    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 20 14:17:36.852388 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:36.852355    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:36.852827 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:36.852705    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:36.853442 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:36.853419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:17:42.360427 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.360395    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"]
Jul 20 14:17:42.361060 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.360639    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8" podUID="2fb06bf8-c2b3-4035-bcf9-ba97708abf82" containerName="maas-api" containerID="cri-o://72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190" gracePeriod=30
Jul 20 14:17:42.627480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.627445    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:42.713360 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.713325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgfcc\" (UniqueName: \"kubernetes.io/projected/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-kube-api-access-jgfcc\") pod \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") "
Jul 20 14:17:42.713540 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.713410    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-openshift-service-ca\") pod \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") "
Jul 20 14:17:42.713540 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.713534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-maas-api-tls\") pod \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\" (UID: \"2fb06bf8-c2b3-4035-bcf9-ba97708abf82\") "
Jul 20 14:17:42.713762 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.713735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fb06bf8-c2b3-4035-bcf9-ba97708abf82" (UID: "2fb06bf8-c2b3-4035-bcf9-ba97708abf82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:17:42.713876 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.713862    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:42.715653 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.715630    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fb06bf8-c2b3-4035-bcf9-ba97708abf82" (UID: "2fb06bf8-c2b3-4035-bcf9-ba97708abf82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:17:42.715723 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.715646    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-kube-api-access-jgfcc" (OuterVolumeSpecName: "kube-api-access-jgfcc") pod "2fb06bf8-c2b3-4035-bcf9-ba97708abf82" (UID: "2fb06bf8-c2b3-4035-bcf9-ba97708abf82"). InnerVolumeSpecName "kube-api-access-jgfcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:17:42.814672 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.814629    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgfcc\" (UniqueName: \"kubernetes.io/projected/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-kube-api-access-jgfcc\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:42.814672 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:42.814667    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb06bf8-c2b3-4035-bcf9-ba97708abf82-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:43.362513 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.362476    2559 generic.go:356] "Generic (PLEG): container finished" podID="2fb06bf8-c2b3-4035-bcf9-ba97708abf82" containerID="72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190" exitCode=0
Jul 20 14:17:43.362943 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.362538    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"
Jul 20 14:17:43.362943 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.362570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8" event={"ID":"2fb06bf8-c2b3-4035-bcf9-ba97708abf82","Type":"ContainerDied","Data":"72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190"}
Jul 20 14:17:43.362943 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.362627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8" event={"ID":"2fb06bf8-c2b3-4035-bcf9-ba97708abf82","Type":"ContainerDied","Data":"2e5422692d7a6730d0446d328b0b0efc30c743ca955002938359e66643db2df9"}
Jul 20 14:17:43.362943 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.362649    2559 scope.go:117] "RemoveContainer" containerID="72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190"
Jul 20 14:17:43.371634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.371617    2559 scope.go:117] "RemoveContainer" containerID="72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190"
Jul 20 14:17:43.371953 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:17:43.371932    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190\": container with ID starting with 72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190 not found: ID does not exist" containerID="72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190"
Jul 20 14:17:43.372025 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.371962    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190"} err="failed to get container status \"72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190\": rpc error: code = NotFound desc = could not find container \"72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190\": container with ID starting with 72a2b57d4f422ad43a0a1f78a3ba9fa8a6a8e602dd17c5979465657cd87c8190 not found: ID does not exist"
Jul 20 14:17:43.379338 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.379309    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"]
Jul 20 14:17:43.383315 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:43.383283    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e9d90e-686487f6bc-sd6c8"]
Jul 20 14:17:45.194004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:45.193967    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb06bf8-c2b3-4035-bcf9-ba97708abf82" path="/var/lib/kubelet/pods/2fb06bf8-c2b3-4035-bcf9-ba97708abf82/volumes"
Jul 20 14:17:54.439318 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:54.439283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"]
Jul 20 14:17:54.439835 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:54.439511    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" containerID="cri-o://0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808" gracePeriod=30
Jul 20 14:17:57.921276 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:57.921224    2559 patch_prober.go:28] interesting pod/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 14:17:57.921677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:57.921301    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 14:17:59.709892 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.709826    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:17:59.875321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875270    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-certs\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875321 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-socket\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875565 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875374    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-podinfo\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875565 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875416    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-token\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875565 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875454    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istiod-ca-cert\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875565 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875481    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-envoy\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875565 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875551    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-data\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875581    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkjzh\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-kube-api-access-gkjzh\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875613    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:59.875824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875630    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-credential-socket\") pod \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\" (UID: \"7cc48d39-32c6-4f53-92bb-c9c42917d61d\") "
Jul 20 14:17:59.875824 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875692    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:59.876054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875972    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.876054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875985    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:59.876054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.875991    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.876686 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.876649    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:17:59.876956 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.876923    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:59.877893 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.877865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:17:59.877893 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.877861    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:17:59.878026 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.877919    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-kube-api-access-gkjzh" (OuterVolumeSpecName: "kube-api-access-gkjzh") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "kube-api-access-gkjzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:17:59.878026 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.877989    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cc48d39-32c6-4f53-92bb-c9c42917d61d" (UID: "7cc48d39-32c6-4f53-92bb-c9c42917d61d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976857    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976893    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976906    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976914    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976922    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976931    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkjzh\" (UniqueName: \"kubernetes.io/projected/7cc48d39-32c6-4f53-92bb-c9c42917d61d-kube-api-access-gkjzh\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:17:59.976958 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:17:59.976940    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc48d39-32c6-4f53-92bb-c9c42917d61d-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:00.453684 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.453643    2559 generic.go:356] "Generic (PLEG): container finished" podID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerID="0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808" exitCode=0
Jul 20 14:18:00.453864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.453691    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"
Jul 20 14:18:00.453864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.453730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" event={"ID":"7cc48d39-32c6-4f53-92bb-c9c42917d61d","Type":"ContainerDied","Data":"0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808"}
Jul 20 14:18:00.453864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.453785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp" event={"ID":"7cc48d39-32c6-4f53-92bb-c9c42917d61d","Type":"ContainerDied","Data":"1105f647db2bb2cbe9c517848c0ccdc501d24329c7ce93505ecab7263a9de14e"}
Jul 20 14:18:00.453864 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.453808    2559 scope.go:117] "RemoveContainer" containerID="0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808"
Jul 20 14:18:00.463791 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.463768    2559 scope.go:117] "RemoveContainer" containerID="9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"
Jul 20 14:18:00.472493 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.472474    2559 scope.go:117] "RemoveContainer" containerID="0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808"
Jul 20 14:18:00.472796 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:18:00.472775    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808\": container with ID starting with 0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808 not found: ID does not exist" containerID="0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808"
Jul 20 14:18:00.472843 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.472806    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808"} err="failed to get container status \"0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808\": rpc error: code = NotFound desc = could not find container \"0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808\": container with ID starting with 0c0b06e71568b3ce48fc52523472af72a923a20e4338d77a4a752c7fb6cd3808 not found: ID does not exist"
Jul 20 14:18:00.472843 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.472830    2559 scope.go:117] "RemoveContainer" containerID="9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"
Jul 20 14:18:00.473059 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:18:00.473041    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c\": container with ID starting with 9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c not found: ID does not exist" containerID="9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"
Jul 20 14:18:00.473100 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.473067    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c"} err="failed to get container status \"9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c\": rpc error: code = NotFound desc = could not find container \"9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c\": container with ID starting with 9ad8bdcf0a0af6c7d39f24d15760505802fa88353c8c5fc310f0c1e9c9cd3a9c not found: ID does not exist"
Jul 20 14:18:00.485786 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.485756    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"]
Jul 20 14:18:00.495502 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:00.495472    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e9d90e-openshift-default-5d7cd68c7f-827kp"]
Jul 20 14:18:01.198850 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:01.198811    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" path="/var/lib/kubelet/pods/7cc48d39-32c6-4f53-92bb-c9c42917d61d/volumes"
Jul 20 14:18:10.333689 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.333654    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"]
Jul 20 14:18:10.334214 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.333923    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" podUID="058671b1-93e2-4254-ab26-e559ccc8d351" containerName="maas-api" containerID="cri-o://8c542bccc8dc444d1e532ed9253bd751fea37661b54d650b313bc42d95214d46" gracePeriod=30
Jul 20 14:18:10.508362 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.508327    2559 generic.go:356] "Generic (PLEG): container finished" podID="058671b1-93e2-4254-ab26-e559ccc8d351" containerID="8c542bccc8dc444d1e532ed9253bd751fea37661b54d650b313bc42d95214d46" exitCode=0
Jul 20 14:18:10.508525 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.508381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" event={"ID":"058671b1-93e2-4254-ab26-e559ccc8d351","Type":"ContainerDied","Data":"8c542bccc8dc444d1e532ed9253bd751fea37661b54d650b313bc42d95214d46"}
Jul 20 14:18:10.594043 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.593963    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:18:10.669230 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.669190    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbrlc\" (UniqueName: \"kubernetes.io/projected/058671b1-93e2-4254-ab26-e559ccc8d351-kube-api-access-xbrlc\") pod \"058671b1-93e2-4254-ab26-e559ccc8d351\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") "
Jul 20 14:18:10.669397 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.669278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/058671b1-93e2-4254-ab26-e559ccc8d351-openshift-service-ca\") pod \"058671b1-93e2-4254-ab26-e559ccc8d351\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") "
Jul 20 14:18:10.669397 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.669354    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls\") pod \"058671b1-93e2-4254-ab26-e559ccc8d351\" (UID: \"058671b1-93e2-4254-ab26-e559ccc8d351\") "
Jul 20 14:18:10.669623 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.669598    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058671b1-93e2-4254-ab26-e559ccc8d351-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "058671b1-93e2-4254-ab26-e559ccc8d351" (UID: "058671b1-93e2-4254-ab26-e559ccc8d351"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:18:10.671592 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.671561    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "058671b1-93e2-4254-ab26-e559ccc8d351" (UID: "058671b1-93e2-4254-ab26-e559ccc8d351"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:18:10.671785 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.671675    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058671b1-93e2-4254-ab26-e559ccc8d351-kube-api-access-xbrlc" (OuterVolumeSpecName: "kube-api-access-xbrlc") pod "058671b1-93e2-4254-ab26-e559ccc8d351" (UID: "058671b1-93e2-4254-ab26-e559ccc8d351"). InnerVolumeSpecName "kube-api-access-xbrlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:18:10.770588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.770550    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/058671b1-93e2-4254-ab26-e559ccc8d351-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:10.770588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.770582    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/058671b1-93e2-4254-ab26-e559ccc8d351-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:10.770588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:10.770593    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbrlc\" (UniqueName: \"kubernetes.io/projected/058671b1-93e2-4254-ab26-e559ccc8d351-kube-api-access-xbrlc\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:11.514676 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:11.514590    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"
Jul 20 14:18:11.515126 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:11.514590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7" event={"ID":"058671b1-93e2-4254-ab26-e559ccc8d351","Type":"ContainerDied","Data":"0f52af80ec246edb76d0f1520715ea4f8b142d42dedc5ae0b9bb219eb5cc0af0"}
Jul 20 14:18:11.515126 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:11.514730    2559 scope.go:117] "RemoveContainer" containerID="8c542bccc8dc444d1e532ed9253bd751fea37661b54d650b313bc42d95214d46"
Jul 20 14:18:11.532981 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:11.532952    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"]
Jul 20 14:18:11.537359 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:11.537336    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2c40e1-d598dd6c-n6kr7"]
Jul 20 14:18:13.193383 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:13.193347    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="058671b1-93e2-4254-ab26-e559ccc8d351" path="/var/lib/kubelet/pods/058671b1-93e2-4254-ab26-e559ccc8d351/volumes"
Jul 20 14:18:16.574392 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:16.574361    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:18:16.585144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:16.585120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:18:21.576148 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:21.576110    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"]
Jul 20 14:18:21.576581 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:21.576340    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" containerID="cri-o://76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04" gracePeriod=30
Jul 20 14:18:21.855480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:21.855395    2559 patch_prober.go:28] interesting pod/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 14:18:21.855480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:21.855458    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 14:18:22.589444 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589407    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"]
Jul 20 14:18:22.589830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589775    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy"
Jul 20 14:18:22.589830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589787    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy"
Jul 20 14:18:22.589830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589803    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058671b1-93e2-4254-ab26-e559ccc8d351" containerName="maas-api"
Jul 20 14:18:22.589830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589808    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="058671b1-93e2-4254-ab26-e559ccc8d351" containerName="maas-api"
Jul 20 14:18:22.589830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589828    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb06bf8-c2b3-4035-bcf9-ba97708abf82" containerName="maas-api"
Jul 20 14:18:22.589830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589834    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb06bf8-c2b3-4035-bcf9-ba97708abf82" containerName="maas-api"
Jul 20 14:18:22.590027 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589890    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy"
Jul 20 14:18:22.590027 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589901    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="058671b1-93e2-4254-ab26-e559ccc8d351" containerName="maas-api"
Jul 20 14:18:22.590027 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.589907    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb06bf8-c2b3-4035-bcf9-ba97708abf82" containerName="maas-api"
Jul 20 14:18:22.592364 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.592341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.594965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.594942    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-57d0e8-openshift-default-dockercfg-825wp\""
Jul 20 14:18:22.603642 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.603617    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"]
Jul 20 14:18:22.682894 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.682853    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-envoy\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683079 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.682946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-podinfo\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683079 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.682999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-token\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683198 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.683076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9fac28-9cd6-447a-a982-47112d3b322a-istiod-ca-cert\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683198 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.683116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x542d\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-kube-api-access-x542d\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683198 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.683186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-data\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683340 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.683219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-certs\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683382 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.683338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-credential-socket\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.683434 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.683387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-socket\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-envoy\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784495 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-podinfo\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784733 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-token\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784733 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9fac28-9cd6-447a-a982-47112d3b322a-istiod-ca-cert\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784733 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x542d\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-kube-api-access-x542d\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784733 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-data\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784929 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-certs\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784929 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-credential-socket\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.784929 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.784848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-socket\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.785139 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.785116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-data\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.785304 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.785278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-socket\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.785389 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.785250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-certs\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.785438 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.785397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-credential-socket\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.785635 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.785609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9fac28-9cd6-447a-a982-47112d3b322a-istiod-ca-cert\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.786928 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.786906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-envoy\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.787152 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.787135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-podinfo\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.802283 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.802251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x542d\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-kube-api-access-x542d\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.803008 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.802987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-token\") pod \"e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") " pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:22.904579 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:22.904541    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:23.066966 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.066932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"]
Jul 20 14:18:23.071238 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:18:23.071205    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9fac28_9cd6_447a_a982_47112d3b322a.slice/crio-09feb1f0fd067a645c9588a1d34420d91cfb1f0fa33491ce737f5f23214508db WatchSource:0}: Error finding container 09feb1f0fd067a645c9588a1d34420d91cfb1f0fa33491ce737f5f23214508db: Status 404 returned error can't find the container with id 09feb1f0fd067a645c9588a1d34420d91cfb1f0fa33491ce737f5f23214508db
Jul 20 14:18:23.073391 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.073354    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:23.073485 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.073422    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:23.073485 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.073452    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:23.578762 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.578719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" event={"ID":"cd9fac28-9cd6-447a-a982-47112d3b322a","Type":"ContainerStarted","Data":"d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"}
Jul 20 14:18:23.578987 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.578808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" event={"ID":"cd9fac28-9cd6-447a-a982-47112d3b322a","Type":"ContainerStarted","Data":"09feb1f0fd067a645c9588a1d34420d91cfb1f0fa33491ce737f5f23214508db"}
Jul 20 14:18:23.615516 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.615459    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podStartSLOduration=1.615443301 podStartE2EDuration="1.615443301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:18:23.614517988 +0000 UTC m=+2408.889762517" watchObservedRunningTime="2026-07-20 14:18:23.615443301 +0000 UTC m=+2408.890687829"
Jul 20 14:18:23.905404 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:23.905367    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:24.910588 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:24.910558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:25.589134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.589097    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:25.590464 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.590434    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:25.757631 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.757596    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"]
Jul 20 14:18:25.757991 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.757978    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy"
Jul 20 14:18:25.758041 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.757992    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy"
Jul 20 14:18:25.758084 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.758067    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc48d39-32c6-4f53-92bb-c9c42917d61d" containerName="istio-proxy"
Jul 20 14:18:25.760279 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.760255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.762710 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.762689    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-57d0e8-serving-cert\""
Jul 20 14:18:25.775986 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.775962    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"]
Jul 20 14:18:25.815608 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.815569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.815806 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.815619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmt8b\" (UniqueName: \"kubernetes.io/projected/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-kube-api-access-pmt8b\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.815806 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.815717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.917193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.917126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.917623 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.917230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.917623 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.917252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmt8b\" (UniqueName: \"kubernetes.io/projected/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-kube-api-access-pmt8b\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.917623 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:18:25.917379    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-serving-cert: secret "maas-api-e2e-shared-a-57d0e8-serving-cert" not found
Jul 20 14:18:25.917623 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:18:25.917465    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls podName:f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7 nodeName:}" failed. No retries permitted until 2026-07-20 14:18:26.417440665 +0000 UTC m=+2411.692685192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls") pod "maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" (UID: "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7") : secret "maas-api-e2e-shared-a-57d0e8-serving-cert" not found
Jul 20 14:18:25.917918 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.917898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:25.928970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:25.928089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmt8b\" (UniqueName: \"kubernetes.io/projected/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-kube-api-access-pmt8b\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:26.422271 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.422226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:26.424848 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.424816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls\") pod \"maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:26.671054 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.671015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:26.838628 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.838606    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"]
Jul 20 14:18:26.838983 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.838964    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:18:26.840742 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:18:26.840721    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9aceb0a_cb67_4822_b52d_bcfdfa2cdac7.slice/crio-6c213088b60381a69649f1534fdf67d5b8986c507210e7c2f29c1809ffe335f1 WatchSource:0}: Error finding container 6c213088b60381a69649f1534fdf67d5b8986c507210e7c2f29c1809ffe335f1: Status 404 returned error can't find the container with id 6c213088b60381a69649f1534fdf67d5b8986c507210e7c2f29c1809ffe335f1
Jul 20 14:18:26.927521 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-envoy\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.927521 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-certs\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.927521 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gmsm\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-kube-api-access-6gmsm\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927540    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-data\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927582    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-credential-socket\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istiod-ca-cert\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-socket\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927677    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-token\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-podinfo\") pod \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\" (UID: \"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b\") "
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927814    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.927945    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:18:26.928098 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.928017    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:18:26.929104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.928243    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:26.929104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.928265    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:26.929104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.928277    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:26.929104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.928342    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:18:26.929104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.928638    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:18:26.930101 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.930079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:18:26.930387 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.930371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:18:26.930586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.930570    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-kube-api-access-6gmsm" (OuterVolumeSpecName: "kube-api-access-6gmsm") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "kube-api-access-6gmsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:18:26.930644 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:26.930583    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" (UID: "bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:18:27.029886 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.029845    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:27.029886 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.029880    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:27.029886 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.029889    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:27.030125 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.029898    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gmsm\" (UniqueName: \"kubernetes.io/projected/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-kube-api-access-6gmsm\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:27.030125 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.029907    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:27.030125 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.029917    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:18:27.602467 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.602376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" event={"ID":"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7","Type":"ContainerStarted","Data":"8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe"}
Jul 20 14:18:27.602467 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.602439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" event={"ID":"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7","Type":"ContainerStarted","Data":"6c213088b60381a69649f1534fdf67d5b8986c507210e7c2f29c1809ffe335f1"}
Jul 20 14:18:27.602711 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.602520    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:27.604280 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.604255    2559 generic.go:356] "Generic (PLEG): container finished" podID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerID="76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04" exitCode=0
Jul 20 14:18:27.604428 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.604304    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"
Jul 20 14:18:27.604428 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.604348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" event={"ID":"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b","Type":"ContainerDied","Data":"76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04"}
Jul 20 14:18:27.604428 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.604406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf" event={"ID":"bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b","Type":"ContainerDied","Data":"d513ec6582f69db4201d52d686ecb4acd2e9c8ecbfa3e8e84065247fce5ae106"}
Jul 20 14:18:27.604543 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.604441    2559 scope.go:117] "RemoveContainer" containerID="76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04"
Jul 20 14:18:27.614478 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.614456    2559 scope.go:117] "RemoveContainer" containerID="e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"
Jul 20 14:18:27.623316 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.623289    2559 scope.go:117] "RemoveContainer" containerID="76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04"
Jul 20 14:18:27.623638 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:18:27.623619    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04\": container with ID starting with 76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04 not found: ID does not exist" containerID="76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04"
Jul 20 14:18:27.623716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.623653    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04"} err="failed to get container status \"76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04\": rpc error: code = NotFound desc = could not find container \"76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04\": container with ID starting with 76f192573c4917b58ad6d878eb912ef6131714e87a486fc3422b548148c64f04 not found: ID does not exist"
Jul 20 14:18:27.623716 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.623672    2559 scope.go:117] "RemoveContainer" containerID="e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"
Jul 20 14:18:27.623899 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:18:27.623884    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a\": container with ID starting with e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a not found: ID does not exist" containerID="e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"
Jul 20 14:18:27.623947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.623904    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a"} err="failed to get container status \"e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a\": rpc error: code = NotFound desc = could not find container \"e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a\": container with ID starting with e1b25e70557b6a364b10c2a5c1680657ef3945586582b8deb8742d44bcf47e4a not found: ID does not exist"
Jul 20 14:18:27.627898 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.627848    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" podStartSLOduration=2.119305416 podStartE2EDuration="2.627832776s" totalImagesPullingTime="508.52736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:18:27.626628026 +0000 UTC m=+2412.901872553" watchObservedRunningTime="2026-07-20 14:18:27.627832776 +0000 UTC m=+2412.903077306"
Jul 20 14:18:27.640386 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.640352    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"]
Jul 20 14:18:27.645813 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:27.645783    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2c40e1-openshift-default-7868858687-f2bbf"]
Jul 20 14:18:29.192830 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:29.192794    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" path="/var/lib/kubelet/pods/bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b/volumes"
Jul 20 14:18:30.932977 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.932939    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"]
Jul 20 14:18:30.933402 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.933357    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy"
Jul 20 14:18:30.933402 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.933370    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy"
Jul 20 14:18:30.933489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.933443    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy"
Jul 20 14:18:30.933489 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.933454    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy"
Jul 20 14:18:30.936124 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.936106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:30.938551 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.938532    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-424aa6-openshift-default-dockercfg-vxqdx\""
Jul 20 14:18:30.948985 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:30.948958    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"]
Jul 20 14:18:31.070276 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-istio-token\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070276 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e339e4-8908-461a-8642-10b5ac999def-istiod-ca-cert\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070533 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-socket\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070533 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9stnh\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-kube-api-access-9stnh\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070533 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-certs\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070533 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e339e4-8908-461a-8642-10b5ac999def-istio-podinfo\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070533 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-credential-socket\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070712 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-envoy\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.070712 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.070652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-data\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171204 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-credential-socket\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171415 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-envoy\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171415 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-data\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171415 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-istio-token\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171415 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e339e4-8908-461a-8642-10b5ac999def-istiod-ca-cert\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171415 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-socket\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9stnh\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-kube-api-access-9stnh\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-certs\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e339e4-8908-461a-8642-10b5ac999def-istio-podinfo\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-credential-socket\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.171890 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-socket\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.172020 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.171996    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-certs\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.172085 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.172075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-data\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.172369 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.172305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e339e4-8908-461a-8642-10b5ac999def-istiod-ca-cert\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.173770 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.173729    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-envoy\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.174088 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.174070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e339e4-8908-461a-8642-10b5ac999def-istio-podinfo\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.180383 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.180348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-istio-token\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.180502 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.180482    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9stnh\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-kube-api-access-9stnh\") pod \"e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") " pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.247809 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.247694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:31.403470 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.403445    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"]
Jul 20 14:18:31.404957 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:18:31.404930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e339e4_8908_461a_8642_10b5ac999def.slice/crio-2e6a8e48730711d58af79af9f9c9797c98fcc2af7153b56e48b48733edfb57c1 WatchSource:0}: Error finding container 2e6a8e48730711d58af79af9f9c9797c98fcc2af7153b56e48b48733edfb57c1: Status 404 returned error can't find the container with id 2e6a8e48730711d58af79af9f9c9797c98fcc2af7153b56e48b48733edfb57c1
Jul 20 14:18:31.407439 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.407394    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:31.407526 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.407492    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:31.407567 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.407538    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:31.632634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.632544    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" event={"ID":"06e339e4-8908-461a-8642-10b5ac999def","Type":"ContainerStarted","Data":"00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"}
Jul 20 14:18:31.632634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.632595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" event={"ID":"06e339e4-8908-461a-8642-10b5ac999def","Type":"ContainerStarted","Data":"2e6a8e48730711d58af79af9f9c9797c98fcc2af7153b56e48b48733edfb57c1"}
Jul 20 14:18:31.652654 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:31.652600    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podStartSLOduration=1.652581324 podStartE2EDuration="1.652581324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:18:31.651257779 +0000 UTC m=+2416.926502310" watchObservedRunningTime="2026-07-20 14:18:31.652581324 +0000 UTC m=+2416.927825911"
Jul 20 14:18:32.248374 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:32.248343    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:32.252779 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:32.252753    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:32.638101 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:32.638011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:32.639071 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:32.639051    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:33.621797 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.621761    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:18:33.880191 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.880067    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"]
Jul 20 14:18:33.880508 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.880492    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy"
Jul 20 14:18:33.880508 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.880508    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc7be1d-9d1c-4652-b7a9-2e9e85c12b5b" containerName="istio-proxy"
Jul 20 14:18:33.882795 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.882774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:33.885119 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.885094    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-424aa6-serving-cert\""
Jul 20 14:18:33.909390 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:33.909353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"]
Jul 20 14:18:34.017712 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.017670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85dwq\" (UniqueName: \"kubernetes.io/projected/cd0d3b89-91fb-478d-926c-0428dff43e90-kube-api-access-85dwq\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.018061 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.018037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0d3b89-91fb-478d-926c-0428dff43e90-openshift-service-ca\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.018315 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.018292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0d3b89-91fb-478d-926c-0428dff43e90-maas-api-tls\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.119870 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.119823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0d3b89-91fb-478d-926c-0428dff43e90-openshift-service-ca\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.119870 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.119870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0d3b89-91fb-478d-926c-0428dff43e90-maas-api-tls\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.120261 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.119955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85dwq\" (UniqueName: \"kubernetes.io/projected/cd0d3b89-91fb-478d-926c-0428dff43e90-kube-api-access-85dwq\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.120548 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.120523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0d3b89-91fb-478d-926c-0428dff43e90-openshift-service-ca\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.122583 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.122558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0d3b89-91fb-478d-926c-0428dff43e90-maas-api-tls\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.127950 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.127922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85dwq\" (UniqueName: \"kubernetes.io/projected/cd0d3b89-91fb-478d-926c-0428dff43e90-kube-api-access-85dwq\") pod \"maas-api-e2e-shared-b-424aa6-8494d56455-6ds42\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.206545 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.206442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:34.380041 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.379730    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"]
Jul 20 14:18:34.382017 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:18:34.381977    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0d3b89_91fb_478d_926c_0428dff43e90.slice/crio-a0de292527503f70017da05113da0265e09c6a8f91e8f7ddada236142e12f970 WatchSource:0}: Error finding container a0de292527503f70017da05113da0265e09c6a8f91e8f7ddada236142e12f970: Status 404 returned error can't find the container with id a0de292527503f70017da05113da0265e09c6a8f91e8f7ddada236142e12f970
Jul 20 14:18:34.651128 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:34.651094    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42" event={"ID":"cd0d3b89-91fb-478d-926c-0428dff43e90","Type":"ContainerStarted","Data":"a0de292527503f70017da05113da0265e09c6a8f91e8f7ddada236142e12f970"}
Jul 20 14:18:35.658722 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:35.658687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42" event={"ID":"cd0d3b89-91fb-478d-926c-0428dff43e90","Type":"ContainerStarted","Data":"2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0"}
Jul 20 14:18:35.659223 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:35.658751    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:35.676863 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:35.676811    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42" podStartSLOduration=2.345974263 podStartE2EDuration="2.676791952s" totalImagesPullingTime="330.817689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 14:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:18:35.674220161 +0000 UTC m=+2420.949464689" watchObservedRunningTime="2026-07-20 14:18:35.676791952 +0000 UTC m=+2420.952036483"
Jul 20 14:18:39.681680 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:39.681645    2559 generic.go:356] "Generic (PLEG): container finished" podID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerID="d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f" exitCode=0
Jul 20 14:18:39.682095 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:39.681718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" event={"ID":"cd9fac28-9cd6-447a-a982-47112d3b322a","Type":"ContainerDied","Data":"d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"}
Jul 20 14:18:39.682191 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:39.682129    2559 scope.go:117] "RemoveContainer" containerID="d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"
Jul 20 14:18:39.683222 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:39.683188    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:39.683302 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:39.683286    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:39.683349 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:39.683334    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:40.589492 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:40.589443    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:40.690070 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:40.690031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" event={"ID":"cd9fac28-9cd6-447a-a982-47112d3b322a","Type":"ContainerStarted","Data":"928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc"}
Jul 20 14:18:40.906642 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:40.906605    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:40.908301 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:40.908241    2559 patch_prober.go:28] interesting pod/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 20 14:18:40.908479 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:40.908349    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 20 14:18:41.669279 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:41.669232    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:18:41.905490 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:41.905453    2559 patch_prober.go:28] interesting pod/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 20 14:18:41.906102 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:41.906055    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 20 14:18:42.905470 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:42.905421    2559 patch_prober.go:28] interesting pod/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 20 14:18:42.905668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:42.905508    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 20 14:18:43.905337 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:43.905296    2559 patch_prober.go:28] interesting pod/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 20 14:18:43.905635 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:43.905605    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 20 14:18:44.909693 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:44.909661    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:44.910194 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:44.909947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:44.910967 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:44.910945    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:18:47.639677 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.639638    2559 patch_prober.go:28] interesting pod/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 20 14:18:47.640104 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.639692    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 20 14:18:47.766938 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.766905    2559 generic.go:356] "Generic (PLEG): container finished" podID="06e339e4-8908-461a-8642-10b5ac999def" containerID="00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d" exitCode=0
Jul 20 14:18:47.767127 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.766981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" event={"ID":"06e339e4-8908-461a-8642-10b5ac999def","Type":"ContainerDied","Data":"00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"}
Jul 20 14:18:47.767421 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.767404    2559 scope.go:117] "RemoveContainer" containerID="00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"
Jul 20 14:18:47.768534 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.768502    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:47.768619 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.768603    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:47.768665 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:47.768651    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 20 14:18:48.774233 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:48.774198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" event={"ID":"06e339e4-8908-461a-8642-10b5ac999def","Type":"ContainerStarted","Data":"a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f"}
Jul 20 14:18:49.248570 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:49.248528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:49.248778 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:49.248753    2559 patch_prober.go:28] interesting pod/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 20 14:18:49.248826 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:49.248808    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 20 14:18:50.248747 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:50.248708    2559 patch_prober.go:28] interesting pod/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 20 14:18:50.249197 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:50.248769    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 20 14:18:51.248188 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:51.248117    2559 patch_prober.go:28] interesting pod/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 20 14:18:51.248351 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:51.248212    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 20 14:18:52.248174 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:52.248122    2559 patch_prober.go:28] interesting pod/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 20 14:18:52.248600 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:52.248207    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 20 14:18:53.252186 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:53.252132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:53.252608 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:53.252590    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:18:53.253222 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:18:53.253205    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:23:16.606419 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:23:16.606339    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:23:16.618831 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:23:16.618802    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:26:16.379767 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.379558    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"]
Jul 20 14:26:16.380480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.380401    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" podUID="f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" containerName="maas-api" containerID="cri-o://8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe" gracePeriod=30
Jul 20 14:26:16.832964 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.832936    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:26:16.971376 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.971285    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmt8b\" (UniqueName: \"kubernetes.io/projected/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-kube-api-access-pmt8b\") pod \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") "
Jul 20 14:26:16.971555 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.971386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls\") pod \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") "
Jul 20 14:26:16.971555 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.971416    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-openshift-service-ca\") pod \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\" (UID: \"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7\") "
Jul 20 14:26:16.971815 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.971791    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" (UID: "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:26:16.973573 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.973544    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-kube-api-access-pmt8b" (OuterVolumeSpecName: "kube-api-access-pmt8b") pod "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" (UID: "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7"). InnerVolumeSpecName "kube-api-access-pmt8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:16.973662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:16.973634    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" (UID: "f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:26:17.072586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.072547    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmt8b\" (UniqueName: \"kubernetes.io/projected/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-kube-api-access-pmt8b\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:17.072586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.072580    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:17.072586 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.072589    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:17.168985 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.168947    2559 generic.go:356] "Generic (PLEG): container finished" podID="f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" containerID="8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe" exitCode=0
Jul 20 14:26:17.169193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.169005    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"
Jul 20 14:26:17.169193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.169024    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" event={"ID":"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7","Type":"ContainerDied","Data":"8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe"}
Jul 20 14:26:17.169193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.169085    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp" event={"ID":"f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7","Type":"ContainerDied","Data":"6c213088b60381a69649f1534fdf67d5b8986c507210e7c2f29c1809ffe335f1"}
Jul 20 14:26:17.169193 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.169107    2559 scope.go:117] "RemoveContainer" containerID="8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe"
Jul 20 14:26:17.179303 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.179277    2559 scope.go:117] "RemoveContainer" containerID="8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe"
Jul 20 14:26:17.179745 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:26:17.179720    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe\": container with ID starting with 8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe not found: ID does not exist" containerID="8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe"
Jul 20 14:26:17.179857 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.179757    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe"} err="failed to get container status \"8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe\": rpc error: code = NotFound desc = could not find container \"8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe\": container with ID starting with 8c29b284b9e89285e14865f74df22ebca9dba944dc37df5811514c9d59138afe not found: ID does not exist"
Jul 20 14:26:17.203946 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.203908    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"]
Jul 20 14:26:17.204132 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:17.204072    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-57d0e8-6c644b9ccf-xfxnp"]
Jul 20 14:26:19.193706 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:19.193656    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" path="/var/lib/kubelet/pods/f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7/volumes"
Jul 20 14:26:27.641242 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:27.641201    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"]
Jul 20 14:26:27.641754 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:27.641486    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy" containerID="cri-o://928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc" gracePeriod=30
Jul 20 14:26:29.912772 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:29.912739    2559 patch_prober.go:28] interesting pod/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 14:26:29.913178 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:29.912828    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 14:26:32.907835 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.907767    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:26:32.928287 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-credential-socket\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928456 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928316    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x542d\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-kube-api-access-x542d\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928456 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928364    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-data\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928456 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928427    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-podinfo\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9fac28-9cd6-447a-a982-47112d3b322a-istiod-ca-cert\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928521    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-envoy\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928543    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-socket\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928576    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-certs\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928572    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:32.928638 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-token\") pod \"cd9fac28-9cd6-447a-a982-47112d3b322a\" (UID: \"cd9fac28-9cd6-447a-a982-47112d3b322a\") "
Jul 20 14:26:32.928947 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928877    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd9fac28-9cd6-447a-a982-47112d3b322a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:26:32.929004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928946    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9fac28-9cd6-447a-a982-47112d3b322a-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:32.929004 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.928965    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:32.929282 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.929234    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:32.929692 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.929664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:32.930260 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.930211    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:32.931671 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.931612    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:26:32.931857 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.931837    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:32.932127 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.932107    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-kube-api-access-x542d" (OuterVolumeSpecName: "kube-api-access-x542d") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "kube-api-access-x542d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:32.932306 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:32.932285    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd9fac28-9cd6-447a-a982-47112d3b322a" (UID: "cd9fac28-9cd6-447a-a982-47112d3b322a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:33.029970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.029934    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.029970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.029964    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.029970 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.029974    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x542d\" (UniqueName: \"kubernetes.io/projected/cd9fac28-9cd6-447a-a982-47112d3b322a-kube-api-access-x542d\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.030245 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.029987    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.030245 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.029995    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.030245 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.030003    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.030245 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.030011    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9fac28-9cd6-447a-a982-47112d3b322a-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:33.255946 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.255910    2559 generic.go:356] "Generic (PLEG): container finished" podID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerID="928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc" exitCode=0
Jul 20 14:26:33.256178 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.255967    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"
Jul 20 14:26:33.256178 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.255994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" event={"ID":"cd9fac28-9cd6-447a-a982-47112d3b322a","Type":"ContainerDied","Data":"928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc"}
Jul 20 14:26:33.256178 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.256066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2" event={"ID":"cd9fac28-9cd6-447a-a982-47112d3b322a","Type":"ContainerDied","Data":"09feb1f0fd067a645c9588a1d34420d91cfb1f0fa33491ce737f5f23214508db"}
Jul 20 14:26:33.256178 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.256096    2559 scope.go:117] "RemoveContainer" containerID="928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc"
Jul 20 14:26:33.265598 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.265577    2559 scope.go:117] "RemoveContainer" containerID="d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"
Jul 20 14:26:33.272108 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.272075    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"]
Jul 20 14:26:33.275012 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.274990    2559 scope.go:117] "RemoveContainer" containerID="928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc"
Jul 20 14:26:33.275357 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:26:33.275336    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc\": container with ID starting with 928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc not found: ID does not exist" containerID="928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc"
Jul 20 14:26:33.275412 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.275368    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc"} err="failed to get container status \"928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc\": rpc error: code = NotFound desc = could not find container \"928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc\": container with ID starting with 928ade1a08a59c6037e8184686acec49743dbbcc1d89e7068e2ec727e0ec70dc not found: ID does not exist"
Jul 20 14:26:33.275412 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.275387    2559 scope.go:117] "RemoveContainer" containerID="d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"
Jul 20 14:26:33.275634 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.275616    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-57d0e8-openshift-default-5c5b8b6d9f-cz5l2"]
Jul 20 14:26:33.275634 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:26:33.275625    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f\": container with ID starting with d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f not found: ID does not exist" containerID="d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"
Jul 20 14:26:33.275708 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:33.275646    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f"} err="failed to get container status \"d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f\": rpc error: code = NotFound desc = could not find container \"d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f\": container with ID starting with d2d4f231b2e8a549d181e889b174b7507de032553855516116c752c49364b42f not found: ID does not exist"
Jul 20 14:26:35.192910 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:35.192873    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" path="/var/lib/kubelet/pods/cd9fac28-9cd6-447a-a982-47112d3b322a/volumes"
Jul 20 14:26:38.518352 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:38.518317    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"]
Jul 20 14:26:38.518840 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:38.518648    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42" podUID="cd0d3b89-91fb-478d-926c-0428dff43e90" containerName="maas-api" containerID="cri-o://2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0" gracePeriod=30
Jul 20 14:26:38.984291 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:38.984263    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:26:39.085572 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.085479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0d3b89-91fb-478d-926c-0428dff43e90-openshift-service-ca\") pod \"cd0d3b89-91fb-478d-926c-0428dff43e90\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") "
Jul 20 14:26:39.085572 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.085556    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85dwq\" (UniqueName: \"kubernetes.io/projected/cd0d3b89-91fb-478d-926c-0428dff43e90-kube-api-access-85dwq\") pod \"cd0d3b89-91fb-478d-926c-0428dff43e90\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") "
Jul 20 14:26:39.085771 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.085664    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0d3b89-91fb-478d-926c-0428dff43e90-maas-api-tls\") pod \"cd0d3b89-91fb-478d-926c-0428dff43e90\" (UID: \"cd0d3b89-91fb-478d-926c-0428dff43e90\") "
Jul 20 14:26:39.085928 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.085906    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0d3b89-91fb-478d-926c-0428dff43e90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd0d3b89-91fb-478d-926c-0428dff43e90" (UID: "cd0d3b89-91fb-478d-926c-0428dff43e90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:26:39.086016 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.086003    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd0d3b89-91fb-478d-926c-0428dff43e90-openshift-service-ca\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:39.087895 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.087871    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0d3b89-91fb-478d-926c-0428dff43e90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd0d3b89-91fb-478d-926c-0428dff43e90" (UID: "cd0d3b89-91fb-478d-926c-0428dff43e90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 14:26:39.087895 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.087886    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd0d3b89-91fb-478d-926c-0428dff43e90-kube-api-access-85dwq" (OuterVolumeSpecName: "kube-api-access-85dwq") pod "cd0d3b89-91fb-478d-926c-0428dff43e90" (UID: "cd0d3b89-91fb-478d-926c-0428dff43e90"). InnerVolumeSpecName "kube-api-access-85dwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:39.186890 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.186846    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85dwq\" (UniqueName: \"kubernetes.io/projected/cd0d3b89-91fb-478d-926c-0428dff43e90-kube-api-access-85dwq\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:39.186890 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.186889    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd0d3b89-91fb-478d-926c-0428dff43e90-maas-api-tls\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:39.289491 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.289445    2559 generic.go:356] "Generic (PLEG): container finished" podID="cd0d3b89-91fb-478d-926c-0428dff43e90" containerID="2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0" exitCode=0
Jul 20 14:26:39.289662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.289498    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"
Jul 20 14:26:39.289662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.289573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42" event={"ID":"cd0d3b89-91fb-478d-926c-0428dff43e90","Type":"ContainerDied","Data":"2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0"}
Jul 20 14:26:39.289662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.289629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42" event={"ID":"cd0d3b89-91fb-478d-926c-0428dff43e90","Type":"ContainerDied","Data":"a0de292527503f70017da05113da0265e09c6a8f91e8f7ddada236142e12f970"}
Jul 20 14:26:39.289662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.289652    2559 scope.go:117] "RemoveContainer" containerID="2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0"
Jul 20 14:26:39.300315 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.300291    2559 scope.go:117] "RemoveContainer" containerID="2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0"
Jul 20 14:26:39.300641 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:26:39.300613    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0\": container with ID starting with 2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0 not found: ID does not exist" containerID="2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0"
Jul 20 14:26:39.300709 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.300655    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0"} err="failed to get container status \"2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0\": rpc error: code = NotFound desc = could not find container \"2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0\": container with ID starting with 2fffac68e79a7bb68ea6d33d5331822a4edca4cc71daaca477ec6db3734268b0 not found: ID does not exist"
Jul 20 14:26:39.307505 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.307476    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"]
Jul 20 14:26:39.310926 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:39.310899    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-424aa6-8494d56455-6ds42"]
Jul 20 14:26:41.193405 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:41.193366    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd0d3b89-91fb-478d-926c-0428dff43e90" path="/var/lib/kubelet/pods/cd0d3b89-91fb-478d-926c-0428dff43e90/volumes"
Jul 20 14:26:49.576144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:49.576109    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"]
Jul 20 14:26:49.576608 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:49.576342    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" containerID="cri-o://a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f" gracePeriod=30
Jul 20 14:26:53.255523 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:53.255486    2559 patch_prober.go:28] interesting pod/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 14:26:53.255973 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:53.255558    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 14:26:54.837674 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.837612    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:26:54.937876 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.937836    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-socket\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.937876 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.937884    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-credential-socket\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.937919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e339e4-8908-461a-8642-10b5ac999def-istiod-ca-cert\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.937958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-envoy\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.937992    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9stnh\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-kube-api-access-9stnh\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938008    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-data\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938039    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-istio-token\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938144 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938125    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-certs\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938140    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:54.938480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938201    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e339e4-8908-461a-8642-10b5ac999def-istio-podinfo\") pod \"06e339e4-8908-461a-8642-10b5ac999def\" (UID: \"06e339e4-8908-461a-8642-10b5ac999def\") "
Jul 20 14:26:54.938480 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:54.938662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938501    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:54.938662 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e339e4-8908-461a-8642-10b5ac999def-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 14:26:54.938770 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938669    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:54.938770 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938696    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-credential-socket\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:54.938770 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.938714    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-workload-certs\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:54.939281 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.939256    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-data" (OuterVolumeSpecName: "istio-data") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:54.940363 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.940334    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 14:26:54.940594 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.940571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-kube-api-access-9stnh" (OuterVolumeSpecName: "kube-api-access-9stnh") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "kube-api-access-9stnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:54.940906 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.940882    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06e339e4-8908-461a-8642-10b5ac999def-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 14:26:54.940906 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:54.940893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-istio-token" (OuterVolumeSpecName: "istio-token") pod "06e339e4-8908-461a-8642-10b5ac999def" (UID: "06e339e4-8908-461a-8642-10b5ac999def"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 14:26:55.039706 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.039650    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06e339e4-8908-461a-8642-10b5ac999def-istiod-ca-cert\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:55.039706 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.039699    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-envoy\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:55.039706 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.039708    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9stnh\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-kube-api-access-9stnh\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:55.039706 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.039716    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06e339e4-8908-461a-8642-10b5ac999def-istio-data\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:55.039706 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.039725    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06e339e4-8908-461a-8642-10b5ac999def-istio-token\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:55.040031 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.039732    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06e339e4-8908-461a-8642-10b5ac999def-istio-podinfo\") on node \"ip-10-0-131-139.ec2.internal\" DevicePath \"\""
Jul 20 14:26:55.373474 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.373441    2559 generic.go:356] "Generic (PLEG): container finished" podID="06e339e4-8908-461a-8642-10b5ac999def" containerID="a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f" exitCode=0
Jul 20 14:26:55.373655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.373488    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"
Jul 20 14:26:55.373655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.373493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" event={"ID":"06e339e4-8908-461a-8642-10b5ac999def","Type":"ContainerDied","Data":"a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f"}
Jul 20 14:26:55.373655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.373616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb" event={"ID":"06e339e4-8908-461a-8642-10b5ac999def","Type":"ContainerDied","Data":"2e6a8e48730711d58af79af9f9c9797c98fcc2af7153b56e48b48733edfb57c1"}
Jul 20 14:26:55.373655 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.373646    2559 scope.go:117] "RemoveContainer" containerID="a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f"
Jul 20 14:26:55.383217 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.383199    2559 scope.go:117] "RemoveContainer" containerID="00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"
Jul 20 14:26:55.394219 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.394189    2559 scope.go:117] "RemoveContainer" containerID="a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f"
Jul 20 14:26:55.394668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.394446    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"]
Jul 20 14:26:55.394668 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:26:55.394557    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f\": container with ID starting with a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f not found: ID does not exist" containerID="a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f"
Jul 20 14:26:55.394668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.394590    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f"} err="failed to get container status \"a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f\": rpc error: code = NotFound desc = could not find container \"a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f\": container with ID starting with a6fc768144fb9e38531e846566341e214ae8d7c7b13b9d50c1ffbae639f0700f not found: ID does not exist"
Jul 20 14:26:55.394668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.394617    2559 scope.go:117] "RemoveContainer" containerID="00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"
Jul 20 14:26:55.395001 ip-10-0-131-139 kubenswrapper[2559]: E0720 14:26:55.394978    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d\": container with ID starting with 00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d not found: ID does not exist" containerID="00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"
Jul 20 14:26:55.395092 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.395012    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d"} err="failed to get container status \"00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d\": rpc error: code = NotFound desc = could not find container \"00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d\": container with ID starting with 00f75996b7b0bc8c7ac4f0c07a48f9accb2671918f4961fb420cb587bbe5467d not found: ID does not exist"
Jul 20 14:26:55.397773 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:55.397750    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-424aa6-openshift-default-cdf984d55-8wrpb"]
Jul 20 14:26:56.199770 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:56.199739    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-slglw_46901df5-f843-46d2-8ba2-5082f9fd86a8/manager/0.log"
Jul 20 14:26:56.329752 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:56.329716    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kq7ml_d7526677-1c32-4e6a-a214-04431510502f/manager/0.log"
Jul 20 14:26:56.983231 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:56.983201    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-pvfnz_a9763c5e-6309-4aa5-9c18-db3492fe8cf2/copy-manifests/0.log"
Jul 20 14:26:56.990902 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:56.990878    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-pvfnz_a9763c5e-6309-4aa5-9c18-db3492fe8cf2/manager/0.log"
Jul 20 14:26:57.192358 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:57.192325    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e339e4-8908-461a-8642-10b5ac999def" path="/var/lib/kubelet/pods/06e339e4-8908-461a-8642-10b5ac999def/volumes"
Jul 20 14:26:57.501318 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:57.501266    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-784d565fd-clg9w_1e74af5e-ef27-407d-98f4-8e386e13780d/maas-api/0.log"
Jul 20 14:26:57.637959 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:57.637934    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742600-9p5fk_1e27db54-86b4-494a-98c0-ba175b5fe395/cleanup/0.log"
Jul 20 14:26:59.457239 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:59.457208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9lrv8_d1820ba4-79f2-4529-84ae-0cd445536f20/manager/0.log"
Jul 20 14:26:59.581869 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:59.581837    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8nmjc_33c4d463-7131-403d-aef5-8d84c878838a/manager/0.log"
Jul 20 14:26:59.706791 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:59.706765    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2k95k_1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc/kuadrant-console-plugin/0.log"
Jul 20 14:26:59.839648 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:59.839564    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rvsjz_b3f6231f-3d88-4dfc-8318-30bbffa96fbd/registry-server/0.log"
Jul 20 14:26:59.982900 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:26:59.982866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xwvft_9d9852ac-edd9-421a-862b-f9eaef24a6bf/manager/0.log"
Jul 20 14:27:00.257896 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:00.257868    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-trzn7_6c01140d-bccc-4d2c-9803-2946be98ee3d/manager/0.log"
Jul 20 14:27:00.639614 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:00.639535    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rpmgh_52b15826-0a53-4243-aab7-b7765c6555e8/istio-proxy/0.log"
Jul 20 14:27:01.030491 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:01.030463    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-smhqm_ba04140c-4fad-4fd9-99f7-030465764932/kube-auth-proxy/0.log"
Jul 20 14:27:01.156721 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:01.156687    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/1.log"
Jul 20 14:27:02.371324 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:02.371289    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnmdg_aa30f818-5d13-46a5-b58d-d8d27c8e0d45/main/0.log"
Jul 20 14:27:02.633576 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:02.633501    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-5j458_2ecd18af-e683-4274-9b1c-e1bf7f889688/main/0.log"
Jul 20 14:27:11.747826 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:11.747792    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5ppt7_2b5f069d-82bd-4c58-8fef-b54c87b9f6a0/global-pull-secret-syncer/0.log"
Jul 20 14:27:11.962900 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:11.962857    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tqh88_6c9a2392-d69a-4447-baf5-cbab4c308510/konnectivity-agent/0.log"
Jul 20 14:27:12.068604 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:12.068522    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-139.ec2.internal_1c5424a690786bcc920675f485fb0103/haproxy/0.log"
Jul 20 14:27:16.851851 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:16.851815    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9lrv8_d1820ba4-79f2-4529-84ae-0cd445536f20/manager/0.log"
Jul 20 14:27:16.890684 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:16.890653    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8nmjc_33c4d463-7131-403d-aef5-8d84c878838a/manager/0.log"
Jul 20 14:27:16.936760 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:16.936736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2k95k_1e0cebc5-c8cc-440e-ab8c-1e043e9b93bc/kuadrant-console-plugin/0.log"
Jul 20 14:27:16.991433 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:16.991399    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rvsjz_b3f6231f-3d88-4dfc-8318-30bbffa96fbd/registry-server/0.log"
Jul 20 14:27:17.188033 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:17.187996    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xwvft_9d9852ac-edd9-421a-862b-f9eaef24a6bf/manager/0.log"
Jul 20 14:27:17.322192 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:17.322144    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-trzn7_6c01140d-bccc-4d2c-9803-2946be98ee3d/manager/0.log"
Jul 20 14:27:19.682466 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:19.682441    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s5tv5_e1b952a9-014a-4fb2-ba7c-ad22636a23e3/node-exporter/0.log"
Jul 20 14:27:19.709943 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:19.709906    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s5tv5_e1b952a9-014a-4fb2-ba7c-ad22636a23e3/kube-rbac-proxy/0.log"
Jul 20 14:27:19.738567 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:19.738546    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s5tv5_e1b952a9-014a-4fb2-ba7c-ad22636a23e3/init-textfile/0.log"
Jul 20 14:27:21.657925 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:21.657892    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-x75kq_4e6cd64f-2485-49f1-93e5-492272ffdbac/networking-console-plugin/0.log"
Jul 20 14:27:22.293445 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.293407    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/1.log"
Jul 20 14:27:22.298092 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.298068    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-lfcx6_512f33c9-f4f1-4202-9881-15a6398d5e9f/console-operator/2.log"
Jul 20 14:27:22.473626 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.473594    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"]
Jul 20 14:27:22.473962 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.473949    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy"
Jul 20 14:27:22.474015 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.473964    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy"
Jul 20 14:27:22.474015 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.473978    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy"
Jul 20 14:27:22.474015 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.473984    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy"
Jul 20 14:27:22.474015 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474004    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy"
Jul 20 14:27:22.474015 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474010    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474017    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474023    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474032    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0d3b89-91fb-478d-926c-0428dff43e90" containerName="maas-api"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474039    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0d3b89-91fb-478d-926c-0428dff43e90" containerName="maas-api"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474046    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" containerName="maas-api"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474051    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" containerName="maas-api"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474109    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0d3b89-91fb-478d-926c-0428dff43e90" containerName="maas-api"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474116    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474121    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9fac28-9cd6-447a-a982-47112d3b322a" containerName="istio-proxy"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474126    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474132    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9aceb0a-cb67-4822-b52d-bcfdfa2cdac7" containerName="maas-api"
Jul 20 14:27:22.474227 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.474139    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e339e4-8908-461a-8642-10b5ac999def" containerName="istio-proxy"
Jul 20 14:27:22.478607 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.478589    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.480871 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.480836    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mzrc5\"/\"default-dockercfg-w8slk\""
Jul 20 14:27:22.481036 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.481022    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzrc5\"/\"openshift-service-ca.crt\""
Jul 20 14:27:22.481842 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.481823    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzrc5\"/\"kube-root-ca.crt\""
Jul 20 14:27:22.484624 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.484603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"]
Jul 20 14:27:22.571546 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.571443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-lib-modules\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.571546 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.571490    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-proc\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.571546 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.571528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-podres\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.571854 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.571647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm482\" (UniqueName: \"kubernetes.io/projected/7da23e34-375d-4356-851c-9f35a64f615e-kube-api-access-mm482\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.571854 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.571720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-sys\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.672702 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-sys\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.672702 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-lib-modules\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-proc\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-podres\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-sys\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-proc\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm482\" (UniqueName: \"kubernetes.io/projected/7da23e34-375d-4356-851c-9f35a64f615e-kube-api-access-mm482\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-lib-modules\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.673134 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.672909    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7da23e34-375d-4356-851c-9f35a64f615e-podres\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.682233 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.682211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm482\" (UniqueName: \"kubernetes.io/projected/7da23e34-375d-4356-851c-9f35a64f615e-kube-api-access-mm482\") pod \"perf-node-gather-daemonset-j7zs5\" (UID: \"7da23e34-375d-4356-851c-9f35a64f615e\") " pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.789925 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.789883    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:22.930998 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:22.930754    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"]
Jul 20 14:27:22.933398 ip-10-0-131-139 kubenswrapper[2559]: W0720 14:27:22.933375    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7da23e34_375d_4356_851c_9f35a64f615e.slice/crio-6137d5cc186ae65357a2688004a628b99050414e6f7afe20324b9d6c963cf6bc WatchSource:0}: Error finding container 6137d5cc186ae65357a2688004a628b99050414e6f7afe20324b9d6c963cf6bc: Status 404 returned error can't find the container with id 6137d5cc186ae65357a2688004a628b99050414e6f7afe20324b9d6c963cf6bc
Jul 20 14:27:23.514589 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:23.514550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5" event={"ID":"7da23e34-375d-4356-851c-9f35a64f615e","Type":"ContainerStarted","Data":"3bc5044011d0c45edf8f4101becf5a1d5ed6c7ea4c7af4092ddeedd07946743f"}
Jul 20 14:27:23.514783 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:23.514609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5" event={"ID":"7da23e34-375d-4356-851c-9f35a64f615e","Type":"ContainerStarted","Data":"6137d5cc186ae65357a2688004a628b99050414e6f7afe20324b9d6c963cf6bc"}
Jul 20 14:27:23.514783 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:23.514669    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:23.530533 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:23.530473    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5" podStartSLOduration=1.5304557989999998 podStartE2EDuration="1.530455799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 14:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 14:27:23.529284052 +0000 UTC m=+2948.804528582" watchObservedRunningTime="2026-07-20 14:27:23.530455799 +0000 UTC m=+2948.805700329"
Jul 20 14:27:23.585155 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:23.585129    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-qpnzg_a35db5e6-9f20-4452-bd97-518fae670e9d/volume-data-source-validator/0.log"
Jul 20 14:27:24.691668 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:24.691638    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qbr68_5fac08ed-7798-439b-93f0-ca7635b58803/dns/0.log"
Jul 20 14:27:24.717979 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:24.717954    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qbr68_5fac08ed-7798-439b-93f0-ca7635b58803/kube-rbac-proxy/0.log"
Jul 20 14:27:24.875285 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:24.875256    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tgj6m_7a431a02-a3be-4869-9b22-5a62f3308d91/dns-node-resolver/0.log"
Jul 20 14:27:25.493742 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:25.493710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx6gq_a5065019-e701-4274-8316-988546bdeffa/node-ca/0.log"
Jul 20 14:27:26.500284 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:26.500254    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rpmgh_52b15826-0a53-4243-aab7-b7765c6555e8/istio-proxy/0.log"
Jul 20 14:27:26.671529 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:26.671491    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-smhqm_ba04140c-4fad-4fd9-99f7-030465764932/kube-auth-proxy/0.log"
Jul 20 14:27:26.706356 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:26.706328    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/0.log"
Jul 20 14:27:26.731262 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:26.731226    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/1.log"
Jul 20 14:27:27.522376 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:27.522347    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m52s_f6989115-a0ea-4c88-ab51-b3187ec6157f/serve-healthcheck-canary/0.log"
Jul 20 14:27:28.036854 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:28.036821    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-d72ts_8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af/insights-operator/0.log"
Jul 20 14:27:28.038049 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:28.038028    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-d72ts_8f3e1c70-208a-4bf5-9f60-1f88bdbbf9af/insights-operator/1.log"
Jul 20 14:27:28.232762 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:28.232730    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lnck5_53508da8-0550-456a-a672-fec202952a85/kube-rbac-proxy/0.log"
Jul 20 14:27:28.259283 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:28.259257    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lnck5_53508da8-0550-456a-a672-fec202952a85/exporter/0.log"
Jul 20 14:27:28.286965 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:28.286894    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lnck5_53508da8-0550-456a-a672-fec202952a85/extractor/0.log"
Jul 20 14:27:29.530939 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:29.530910    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mzrc5/perf-node-gather-daemonset-j7zs5"
Jul 20 14:27:30.743315 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:30.743283    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-slglw_46901df5-f843-46d2-8ba2-5082f9fd86a8/manager/0.log"
Jul 20 14:27:30.928877 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:30.928843    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kq7ml_d7526677-1c32-4e6a-a214-04431510502f/manager/0.log"
Jul 20 14:27:31.364471 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:31.364387    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-pvfnz_a9763c5e-6309-4aa5-9c18-db3492fe8cf2/manager/0.log"
Jul 20 14:27:31.390683 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:31.390650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b98c56445-pvfnz_a9763c5e-6309-4aa5-9c18-db3492fe8cf2/copy-manifests/0.log"
Jul 20 14:27:32.753314 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:32.753284    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rpmgh_52b15826-0a53-4243-aab7-b7765c6555e8/istio-proxy/0.log"
Jul 20 14:27:32.908211 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:32.908152    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-smhqm_ba04140c-4fad-4fd9-99f7-030465764932/kube-auth-proxy/0.log"
Jul 20 14:27:32.933746 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:32.933711    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/0.log"
Jul 20 14:27:32.949331 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:32.949223    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hd8x4_2b095b98-b04f-4697-a6fc-d7b0e5817b05/openshift-lws-operator/0.log"
Jul 20 14:27:32.965105 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:32.965067    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/1.log"
Jul 20 14:27:34.354938 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:34.354902    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rpmgh_52b15826-0a53-4243-aab7-b7765c6555e8/istio-proxy/0.log"
Jul 20 14:27:34.511598 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:34.511504    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8667c86565-smhqm_ba04140c-4fad-4fd9-99f7-030465764932/kube-auth-proxy/0.log"
Jul 20 14:27:34.533599 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:34.533570    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/0.log"
Jul 20 14:27:34.559590 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:34.559560    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gwrc7_bc51584f-d956-43e0-bcf3-194540f5aae5/istio-proxy/1.log"
Jul 20 14:27:38.533787 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:38.533710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-5rm2t_c00aa2ee-9db5-4fed-a02e-88e5f2b10092/migrator/0.log"
Jul 20 14:27:38.564424 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:38.564394    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-5rm2t_c00aa2ee-9db5-4fed-a02e-88e5f2b10092/graceful-termination/0.log"
Jul 20 14:27:38.986154 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:38.986120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gplzr_104176dc-4e6f-4a05-b180-7e2517289df2/kube-storage-version-migrator-operator/1.log"
Jul 20 14:27:38.987050 ip-10-0-131-139 kubenswrapper[2559]: I0720 14:27:38.987032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gplzr_104176dc-4e6f-4a05-b180-7e2517289df2/kube-storage-version-migrator-operator/0.log"